2024-09-13T05:28:41.103 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T05:28:41.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T05:28:41.202 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-09-13_05:00:55-orch:cephadm-wip-guits-main-2024-09-12-1245-distro-default-smithi/7903136 branch: wip-guits-main-2024-09-12-1245 description: orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} email: gabrioux@ibm.com first_in_suite: false job_id: '7903136' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: gabrioux-2024-09-13_05:00:55-orch:cephadm-wip-guits-main-2024-09-12-1245-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-guits-main-2024-09-12-1245 ceph: conf: client: debug ms: 1 global: mon election default strategy: 3 ms bind msgr1: false ms bind msgr2: true ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - CEPHADM_STRAY_DAEMON log-only-match: - CEPHADM_ sha1: 9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: root install: ceph: flavor: default sha1: 9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 workunit: branch: wip-guits-main-2024-09-12-1245 sha1: 9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 1848 sha1: 9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-main-2024-09-12-1245 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 targets: smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDQTyexdsmGv3dK5euI0quhf0+Gp6Fh8XwMonACYD58Q4ogU5GoCUwBsdhT8XAsRZsCoeD1oCarbWOeAlOWfTPE= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBpRmuP/H6EGWbbEGY7YefrsBqf8VgUaa72z+3aM7HmfSXDYnGM+jJjv8ZyNZ9ZlhtuhJEtysMv3n6jMWxs/ZyQ= tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_05:00:55 tube: smithi user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T05:28:41.202 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/qa; will attempt to use it 2024-09-13T05:28:41.203 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/qa/tasks 2024-09-13T05:28:41.203 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T05:28:41.205 INFO:teuthology.task.internal:Checking packages... 2024-09-13T05:28:41.226 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3' 2024-09-13T05:28:41.226 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T05:28:41.226 INFO:teuthology.packaging:ref: None 2024-09-13T05:28:41.227 INFO:teuthology.packaging:tag: None 2024-09-13T05:28:41.227 INFO:teuthology.packaging:branch: wip-guits-main-2024-09-12-1245 2024-09-13T05:28:41.227 INFO:teuthology.packaging:sha1: 9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 2024-09-13T05:28:41.227 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-guits-main-2024-09-12-1245 2024-09-13T05:28:41.379 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4911-g9d608eb1-1jammy 2024-09-13T05:28:41.381 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T05:28:41.391 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T05:28:41.391 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T05:28:41.402 INFO:teuthology.task.internal:Saving configuration 2024-09-13T05:28:41.411 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T05:28:41.422 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T05:28:41.455 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-13_05:00:55-orch:cephadm-wip-guits-main-2024-09-12-1245-distro-default-smithi/7903136', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 05:23:15.361629', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINyRaCDpl6/PT8xoLk2C768n3XQOTbriJjjJQGp2Xx4P'} 2024-09-13T05:28:41.486 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-13_05:00:55-orch:cephadm-wip-guits-main-2024-09-12-1245-distro-default-smithi/7903136', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 05:23:15.360125', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICaPZgpkFnwtXdVzsbW6dgZefADLI4DN58X76X800tEq'} 2024-09-13T05:28:41.486 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T05:28:41.496 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-09-13T05:28:41.497 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-09-13T05:28:41.497 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T05:28:41.577 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f981bfbbbe0>, signals=[15]) 2024-09-13T05:28:41.577 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T05:28:41.587 INFO:teuthology.task.internal:Opening connections... 2024-09-13T05:28:41.587 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-09-13T05:28:41.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:28:41.689 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T05:28:41.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:28:41.779 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T05:28:41.789 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-09-13T05:28:41.795 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-09-13T05:28:41.795 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-09-13T05:28:41.842 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T05:28:41.842 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Ubuntu" 2024-09-13T05:28:41.843 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="22.04" 2024-09-13T05:28:41.843 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T05:28:41.843 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_CODENAME=jammy 2024-09-13T05:28:41.843 INFO:teuthology.orchestra.run.smithi079.stdout:ID=ubuntu 2024-09-13T05:28:41.843 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE=debian 2024-09-13T05:28:41.843 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T05:28:41.843 INFO:teuthology.orchestra.run.smithi079.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T05:28:41.843 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T05:28:41.843 INFO:teuthology.orchestra.run.smithi079.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T05:28:41.844 INFO:teuthology.orchestra.run.smithi079.stdout:UBUNTU_CODENAME=jammy 2024-09-13T05:28:41.844 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-09-13T05:28:41.872 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-09-13T05:28:41.877 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-09-13T05:28:41.877 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-09-13T05:28:41.923 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T05:28:41.923 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2024-09-13T05:28:41.924 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="22.04" 2024-09-13T05:28:41.924 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T05:28:41.924 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=jammy 2024-09-13T05:28:41.924 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2024-09-13T05:28:41.924 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2024-09-13T05:28:41.924 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T05:28:41.924 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T05:28:41.924 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T05:28:41.924 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T05:28:41.924 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=jammy 2024-09-13T05:28:41.925 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-09-13T05:28:41.955 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T05:28:41.968 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T05:28:42.002 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T05:28:42.002 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-09-13T05:28:42.004 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-09-13T05:28:42.009 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T05:28:42.018 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T05:28:42.019 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-09-13T05:28:42.052 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-09-13T05:28:42.068 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T05:28:42.139 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T05:28:42.155 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T05:28:42.156 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T05:28:42.156 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T05:28:42.156 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T05:28:42.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:28:42.161 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-09-13T05:28:42.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:28:42.162 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-13T05:28:42.207 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-56-generic 2024-09-13T05:28:42.208 INFO:teuthology.task.kernel:Running kernel on smithi079: 5.15.0-56-generic 2024-09-13T05:28:42.208 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2024-09-13T05:28:42.209 INFO:teuthology.orchestra.run.smithi139.stdout:5.15.0-56-generic 2024-09-13T05:28:42.209 INFO:teuthology.task.kernel:Running kernel on smithi139: 5.15.0-56-generic 2024-09-13T05:28:42.210 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get clean 2024-09-13T05:28:42.331 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-13T05:28:42.414 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2024-09-13T05:28:42.598 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T05:28:42.608 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T05:28:42.664 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T05:28:42.707 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T05:28:42.708 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T05:28:42.760 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T05:28:43.021 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T05:28:43.041 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T05:28:43.115 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T05:28:43.136 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T05:28:43.159 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T05:28:43.254 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T05:28:43.336 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T05:28:43.353 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,022 kB] 2024-09-13T05:28:43.428 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T05:28:43.447 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,022 kB] 2024-09-13T05:28:43.509 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T05:28:43.512 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T05:28:43.521 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T05:28:43.522 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T05:28:43.524 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T05:28:43.526 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T05:28:43.527 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T05:28:43.596 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T05:28:43.602 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T05:28:43.604 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T05:28:43.606 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T05:28:43.608 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T05:28:43.613 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T05:28:43.615 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T05:28:43.615 INFO:teuthology.orchestra.run.smithi139.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T05:28:43.615 INFO:teuthology.orchestra.run.smithi139.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T05:28:43.616 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T05:28:43.620 INFO:teuthology.orchestra.run.smithi139.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T05:28:43.621 INFO:teuthology.orchestra.run.smithi139.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T05:28:43.645 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T05:28:43.645 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T05:28:43.660 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T05:28:43.664 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T05:28:43.670 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T05:28:43.672 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T05:28:43.675 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T05:28:43.675 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T05:28:43.676 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T05:28:43.676 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T05:28:43.676 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T05:28:43.677 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T05:28:43.690 INFO:teuthology.orchestra.run.smithi139.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T05:28:43.692 INFO:teuthology.orchestra.run.smithi139.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T05:28:43.700 INFO:teuthology.orchestra.run.smithi139.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T05:28:43.701 INFO:teuthology.orchestra.run.smithi139.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T05:28:43.729 INFO:teuthology.orchestra.run.smithi139.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T05:28:43.729 INFO:teuthology.orchestra.run.smithi139.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T05:28:43.730 INFO:teuthology.orchestra.run.smithi139.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T05:28:43.730 INFO:teuthology.orchestra.run.smithi139.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T05:28:43.740 INFO:teuthology.orchestra.run.smithi139.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T05:28:43.742 INFO:teuthology.orchestra.run.smithi139.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T05:28:43.749 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T05:28:43.750 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T05:28:43.750 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T05:28:43.751 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T05:28:43.753 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T05:28:43.755 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T05:28:43.758 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T05:28:43.758 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T05:28:43.758 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T05:28:43.759 INFO:teuthology.orchestra.run.smithi139.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T05:28:43.760 INFO:teuthology.orchestra.run.smithi139.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T05:28:43.763 INFO:teuthology.orchestra.run.smithi139.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T05:28:43.766 INFO:teuthology.orchestra.run.smithi139.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T05:28:43.766 INFO:teuthology.orchestra.run.smithi139.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T05:28:43.767 INFO:teuthology.orchestra.run.smithi139.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T05:28:43.771 INFO:teuthology.orchestra.run.smithi139.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T05:28:43.772 INFO:teuthology.orchestra.run.smithi139.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T05:28:43.839 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T05:28:43.840 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T05:28:43.844 INFO:teuthology.orchestra.run.smithi139.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T05:28:43.845 INFO:teuthology.orchestra.run.smithi139.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T05:28:43.845 INFO:teuthology.orchestra.run.smithi139.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T05:28:43.847 INFO:teuthology.orchestra.run.smithi139.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T05:28:43.848 INFO:teuthology.orchestra.run.smithi139.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T05:28:43.848 INFO:teuthology.orchestra.run.smithi139.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T05:28:43.849 INFO:teuthology.orchestra.run.smithi139.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T05:28:43.852 INFO:teuthology.orchestra.run.smithi139.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T05:28:43.853 INFO:teuthology.orchestra.run.smithi139.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T05:28:43.854 INFO:teuthology.orchestra.run.smithi139.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T05:28:43.934 INFO:teuthology.orchestra.run.smithi139.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T05:28:43.935 INFO:teuthology.orchestra.run.smithi139.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T05:28:49.717 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 16.0 MB in 3s (5,891 kB/s) 2024-09-13T05:28:50.077 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 16.0 MB in 3s (5,913 kB/s) 2024-09-13T05:28:51.226 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-13T05:28:51.245 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T05:28:51.306 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-13T05:28:51.470 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T05:28:51.486 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T05:28:51.517 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-13T05:28:51.517 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-13T05:28:51.538 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T05:28:51.690 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T05:28:51.690 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T05:28:51.691 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T05:28:51.691 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T05:28:51.691 INFO:teuthology.orchestra.run.smithi079.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T05:28:51.691 INFO:teuthology.orchestra.run.smithi079.stdout: python2.7-minimal 2024-09-13T05:28:51.691 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T05:28:51.692 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2024-09-13T05:28:51.692 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T05:28:51.692 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T05:28:51.693 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T05:28:51.694 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2024-09-13T05:28:51.694 INFO:teuthology.orchestra.run.smithi079.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T05:28:51.694 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2024-09-13T05:28:51.694 INFO:teuthology.orchestra.run.smithi079.stdout: thermald 2024-09-13T05:28:51.723 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-09-13T05:28:51.723 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-09-13T05:28:51.746 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2024-09-13T05:28:51.746 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T05:28:51.746 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T05:28:51.747 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T05:28:51.748 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages will be upgraded: 2024-09-13T05:28:51.748 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T05:28:51.818 INFO:teuthology.orchestra.run.smithi079.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T05:28:51.818 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 113 MB of archives. 2024-09-13T05:28:51.818 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T05:28:51.818 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T05:28:51.890 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T05:28:51.890 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T05:28:51.890 INFO:teuthology.orchestra.run.smithi139.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T05:28:51.891 INFO:teuthology.orchestra.run.smithi139.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T05:28:51.891 INFO:teuthology.orchestra.run.smithi139.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T05:28:51.891 INFO:teuthology.orchestra.run.smithi139.stdout: python2.7-minimal 2024-09-13T05:28:51.891 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T05:28:51.892 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2024-09-13T05:28:51.892 INFO:teuthology.orchestra.run.smithi139.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T05:28:51.892 INFO:teuthology.orchestra.run.smithi139.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T05:28:51.893 INFO:teuthology.orchestra.run.smithi139.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T05:28:51.894 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2024-09-13T05:28:51.894 INFO:teuthology.orchestra.run.smithi139.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T05:28:51.894 INFO:teuthology.orchestra.run.smithi139.stdout:Recommended packages: 2024-09-13T05:28:51.894 INFO:teuthology.orchestra.run.smithi139.stdout: thermald 2024-09-13T05:28:51.942 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2024-09-13T05:28:51.942 INFO:teuthology.orchestra.run.smithi139.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T05:28:51.943 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T05:28:51.943 INFO:teuthology.orchestra.run.smithi139.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T05:28:51.944 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages will be upgraded: 2024-09-13T05:28:51.944 INFO:teuthology.orchestra.run.smithi139.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T05:28:51.996 INFO:teuthology.orchestra.run.smithi139.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T05:28:51.997 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 113 MB of archives. 2024-09-13T05:28:51.997 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T05:28:51.997 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T05:28:52.223 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T05:28:52.306 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T05:28:52.413 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T05:28:52.503 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T05:28:53.115 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T05:28:53.115 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T05:28:53.115 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T05:28:53.235 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T05:28:53.255 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T05:28:53.303 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T05:28:53.303 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T05:28:53.303 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T05:28:53.421 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T05:28:53.441 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T05:28:53.650 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 113 MB in 2s (72.4 MB/s) 2024-09-13T05:28:53.854 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T05:28:53.929 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 113 MB in 2s (72.7 MB/s) 2024-09-13T05:28:54.110 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T05:28:55.945 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T05:28:55.949 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:28:56.030 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T05:28:56.034 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:28:56.051 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:28:56.115 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:28:58.211 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T05:28:58.233 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:28:58.334 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:28:58.825 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T05:28:58.846 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:28:58.856 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T05:28:58.877 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:28:58.942 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:28:59.065 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:28:59.419 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T05:28:59.440 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:28:59.477 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:29:06.012 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T05:29:06.073 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T05:29:06.120 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T05:29:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T05:29:06.420 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T05:29:06.517 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T05:29:06.548 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T05:29:06.628 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T05:29:06.851 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T05:29:06.874 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T05:29:06.918 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T05:29:06.931 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T05:29:06.942 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T05:29:06.981 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T05:29:12.398 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T05:29:12.434 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:29:12.473 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:29:12.772 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T05:29:12.809 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:29:12.847 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:29:15.410 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T05:29:15.532 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T05:29:15.603 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T05:29:15.725 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T05:29:15.907 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T05:29:16.028 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:29:16.067 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T05:29:16.154 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T05:29:16.205 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:29:16.282 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:29:16.331 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T05:29:16.442 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:29:17.619 INFO:teuthology.orchestra.run.smithi139.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T05:29:17.619 INFO:teuthology.orchestra.run.smithi139.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T05:29:17.619 INFO:teuthology.orchestra.run.smithi139.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T05:29:17.619 INFO:teuthology.orchestra.run.smithi139.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T05:29:17.760 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T05:29:17.760 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T05:29:17.760 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T05:29:17.760 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T05:29:17.776 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:29:17.962 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:29:19.202 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:29:20.146 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:29:20.596 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T05:29:20.738 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T05:29:20.864 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:29:20.924 INFO:teuthology.orchestra.run.smithi139.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T05:29:20.924 INFO:teuthology.orchestra.run.smithi139.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T05:29:21.573 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T05:29:21.698 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T05:29:21.825 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:29:21.906 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T05:29:21.906 INFO:teuthology.orchestra.run.smithi079.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T05:29:35.027 INFO:teuthology.orchestra.run.smithi139.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T05:29:35.028 INFO:teuthology.orchestra.run.smithi139.stdout:Sourcing file `/etc/default/grub' 2024-09-13T05:29:35.046 INFO:teuthology.orchestra.run.smithi139.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T05:29:35.062 INFO:teuthology.orchestra.run.smithi139.stdout:Generating grub configuration file ... 2024-09-13T05:29:35.322 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T05:29:35.337 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T05:29:35.630 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T05:29:35.636 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T05:29:35.698 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T05:29:35.704 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T05:29:35.870 INFO:teuthology.orchestra.run.smithi139.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T05:29:35.871 INFO:teuthology.orchestra.run.smithi139.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T05:29:35.871 INFO:teuthology.orchestra.run.smithi139.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T05:29:35.901 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T05:29:35.901 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub' 2024-09-13T05:29:35.914 INFO:teuthology.orchestra.run.smithi139.stdout:done 2024-09-13T05:29:35.933 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T05:29:35.956 INFO:teuthology.orchestra.run.smithi079.stdout:Generating grub configuration file ... 2024-09-13T05:29:36.237 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T05:29:36.264 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T05:29:36.437 DEBUG:teuthology.orchestra.run.smithi139:> dpkg -s linux-image-generic 2024-09-13T05:29:36.465 INFO:teuthology.orchestra.run.smithi139.stdout:Package: linux-image-generic 2024-09-13T05:29:36.466 INFO:teuthology.orchestra.run.smithi139.stdout:Status: install ok installed 2024-09-13T05:29:36.466 INFO:teuthology.orchestra.run.smithi139.stdout:Priority: optional 2024-09-13T05:29:36.466 INFO:teuthology.orchestra.run.smithi139.stdout:Section: kernel 2024-09-13T05:29:36.466 INFO:teuthology.orchestra.run.smithi139.stdout:Installed-Size: 21 2024-09-13T05:29:36.466 INFO:teuthology.orchestra.run.smithi139.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T05:29:36.466 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: amd64 2024-09-13T05:29:36.466 INFO:teuthology.orchestra.run.smithi139.stdout:Source: linux-meta 2024-09-13T05:29:36.466 INFO:teuthology.orchestra.run.smithi139.stdout:Version: 5.15.0.121.121 2024-09-13T05:29:36.466 INFO:teuthology.orchestra.run.smithi139.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T05:29:36.466 INFO:teuthology.orchestra.run.smithi139.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T05:29:36.466 INFO:teuthology.orchestra.run.smithi139.stdout:Recommends: thermald 2024-09-13T05:29:36.467 INFO:teuthology.orchestra.run.smithi139.stdout:Description: Generic Linux kernel image 2024-09-13T05:29:36.467 INFO:teuthology.orchestra.run.smithi139.stdout: This package will always depend on the latest generic kernel image 2024-09-13T05:29:36.467 INFO:teuthology.orchestra.run.smithi139.stdout: available. 2024-09-13T05:29:36.467 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T05:29:36.467 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T05:29:36.467 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T05:29:36.467 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-13T05:29:36.468 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi139.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T05:29:36.468 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get clean 2024-09-13T05:29:36.573 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T05:29:36.579 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T05:29:36.643 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T05:29:36.649 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T05:29:36.662 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2024-09-13T05:29:36.793 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T05:29:36.794 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T05:29:36.805 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T05:29:36.822 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T05:29:36.831 INFO:teuthology.orchestra.run.smithi079.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T05:29:36.831 INFO:teuthology.orchestra.run.smithi079.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T05:29:36.831 INFO:teuthology.orchestra.run.smithi079.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T05:29:36.864 INFO:teuthology.orchestra.run.smithi079.stdout:done 2024-09-13T05:29:37.334 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2024-09-13T05:29:37.372 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2024-09-13T05:29:37.372 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2024-09-13T05:29:37.372 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2024-09-13T05:29:37.372 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2024-09-13T05:29:37.373 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 21 2024-09-13T05:29:37.373 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T05:29:37.373 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2024-09-13T05:29:37.373 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2024-09-13T05:29:37.373 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 5.15.0.121.121 2024-09-13T05:29:37.373 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T05:29:37.373 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T05:29:37.373 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2024-09-13T05:29:37.374 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2024-09-13T05:29:37.374 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2024-09-13T05:29:37.374 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2024-09-13T05:29:37.375 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T05:29:37.375 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T05:29:37.375 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T05:29:37.375 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T05:29:37.375 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T05:29:37.375 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2024-09-13T05:29:37.532 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-13T05:29:37.775 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T05:29:37.782 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T05:29:37.846 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T05:29:37.927 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T05:29:38.214 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T05:29:38.234 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T05:29:38.287 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T05:29:38.474 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-09-13T05:29:38.474 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-09-13T05:29:38.642 INFO:teuthology.orchestra.run.smithi139.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T05:29:38.642 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T05:29:38.642 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T05:29:38.642 INFO:teuthology.orchestra.run.smithi139.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T05:29:38.642 INFO:teuthology.orchestra.run.smithi139.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T05:29:38.643 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T05:29:38.643 INFO:teuthology.orchestra.run.smithi139.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T05:29:38.643 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T05:29:38.683 INFO:teuthology.orchestra.run.smithi139.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T05:29:38.686 DEBUG:teuthology.orchestra.run.smithi139:> dpkg -s linux-image-generic 2024-09-13T05:29:38.742 INFO:teuthology.orchestra.run.smithi139.stdout:Package: linux-image-generic 2024-09-13T05:29:38.742 INFO:teuthology.orchestra.run.smithi139.stdout:Status: install ok installed 2024-09-13T05:29:38.742 INFO:teuthology.orchestra.run.smithi139.stdout:Priority: optional 2024-09-13T05:29:38.742 INFO:teuthology.orchestra.run.smithi139.stdout:Section: kernel 2024-09-13T05:29:38.742 INFO:teuthology.orchestra.run.smithi139.stdout:Installed-Size: 21 2024-09-13T05:29:38.742 INFO:teuthology.orchestra.run.smithi139.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T05:29:38.742 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: amd64 2024-09-13T05:29:38.742 INFO:teuthology.orchestra.run.smithi139.stdout:Source: linux-meta 2024-09-13T05:29:38.742 INFO:teuthology.orchestra.run.smithi139.stdout:Version: 5.15.0.121.121 2024-09-13T05:29:38.743 INFO:teuthology.orchestra.run.smithi139.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T05:29:38.743 INFO:teuthology.orchestra.run.smithi139.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T05:29:38.743 INFO:teuthology.orchestra.run.smithi139.stdout:Recommends: thermald 2024-09-13T05:29:38.743 INFO:teuthology.orchestra.run.smithi139.stdout:Description: Generic Linux kernel image 2024-09-13T05:29:38.743 INFO:teuthology.orchestra.run.smithi139.stdout: This package will always depend on the latest generic kernel image 2024-09-13T05:29:38.743 INFO:teuthology.orchestra.run.smithi139.stdout: available. 2024-09-13T05:29:38.743 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-09-13T05:29:38.787 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.DsZSmqE5J4 2024-09-13T05:29:38.787 DEBUG:teuthology.orchestra.run.smithi139:> sudo cp /boot/grub/grub.cfg /tmp/tmp.DsZSmqE5J4 2024-09-13T05:29:38.843 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.DsZSmqE5J4 2024-09-13T05:29:38.972 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.DsZSmqE5J4 is 10KB 2024-09-13T05:29:38.985 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.DsZSmqE5J4 2024-09-13T05:29:38.990 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T05:29:39.042 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T05:29:39.042 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T05:29:39.042 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T05:29:39.117 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T05:29:39.118 DEBUG:teuthology.orchestra.run.smithi139:> sudo update-grub 2024-09-13T05:29:39.199 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-13T05:29:39.217 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T05:29:39.270 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-13T05:29:39.457 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-13T05:29:39.458 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-13T05:29:39.623 INFO:teuthology.orchestra.run.smithi079.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T05:29:39.623 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T05:29:39.623 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T05:29:39.623 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T05:29:39.623 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T05:29:39.624 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T05:29:39.624 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T05:29:39.624 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T05:29:39.662 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T05:29:39.664 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2024-09-13T05:29:39.721 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2024-09-13T05:29:39.721 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2024-09-13T05:29:39.721 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2024-09-13T05:29:39.721 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2024-09-13T05:29:39.721 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 21 2024-09-13T05:29:39.721 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T05:29:39.721 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2024-09-13T05:29:39.721 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2024-09-13T05:29:39.721 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 5.15.0.121.121 2024-09-13T05:29:39.721 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T05:29:39.722 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T05:29:39.722 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2024-09-13T05:29:39.722 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2024-09-13T05:29:39.722 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2024-09-13T05:29:39.722 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2024-09-13T05:29:39.722 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-09-13T05:29:39.765 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.08vsuvwB92 2024-09-13T05:29:39.766 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub/grub.cfg /tmp/tmp.08vsuvwB92 2024-09-13T05:29:39.822 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.08vsuvwB92 2024-09-13T05:29:39.940 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.08vsuvwB92 is 10KB 2024-09-13T05:29:39.954 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.08vsuvwB92 2024-09-13T05:29:39.959 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T05:29:40.013 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:29:40.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T05:29:40.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T05:29:40.081 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T05:29:40.082 DEBUG:teuthology.orchestra.run.smithi079:> sudo update-grub 2024-09-13T05:29:40.302 INFO:teuthology.orchestra.run.smithi139.stderr:Sourcing file `/etc/default/grub' 2024-09-13T05:29:40.303 INFO:teuthology.orchestra.run.smithi139.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T05:29:40.305 INFO:teuthology.orchestra.run.smithi139.stderr:Generating grub configuration file ... 2024-09-13T05:29:40.484 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T05:29:40.490 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T05:29:40.711 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T05:29:40.716 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T05:29:40.759 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T05:29:40.764 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T05:29:40.881 INFO:teuthology.orchestra.run.smithi139.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T05:29:40.882 INFO:teuthology.orchestra.run.smithi139.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T05:29:40.882 INFO:teuthology.orchestra.run.smithi139.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T05:29:40.892 INFO:teuthology.orchestra.run.smithi139.stderr:done 2024-09-13T05:29:40.910 DEBUG:teuthology.orchestra.run.smithi139:> sudo shutdown -r now 2024-09-13T05:29:41.292 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub' 2024-09-13T05:29:41.293 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T05:29:41.295 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2024-09-13T05:29:41.478 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T05:29:41.484 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T05:29:41.761 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T05:29:41.766 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T05:29:41.804 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T05:29:41.809 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T05:29:41.917 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T05:29:41.917 INFO:teuthology.orchestra.run.smithi079.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T05:29:41.917 INFO:teuthology.orchestra.run.smithi079.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T05:29:41.926 INFO:teuthology.orchestra.run.smithi079.stderr:done 2024-09-13T05:29:41.929 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2024-09-13T05:30:10.930 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-13T05:30:10.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T05:30:10.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:30:11.933 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T05:30:11.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-13T05:30:11.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:30:29.312 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-13T05:30:30.341 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-13T05:30:38.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T05:30:38.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:30:39.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-13T05:30:39.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:30:41.408 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-13T05:30:42.432 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-13T05:30:53.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T05:30:53.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:30:54.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-13T05:30:54.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:31:11.805 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-13T05:31:26.159 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-13T05:31:26.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-13T05:31:26.731 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-13T05:31:26.731 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-09-13T05:31:26.778 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-121-generic 2024-09-13T05:31:26.778 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T05:31:26.778 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T05:31:26.779 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T05:31:26.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T05:31:26.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:31:27.185 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-13T05:31:27.780 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T05:31:27.780 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T05:31:28.075 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T05:31:28.075 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-13T05:31:28.075 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-13T05:31:28.121 INFO:teuthology.orchestra.run.smithi139.stdout:5.15.0-121-generic 2024-09-13T05:31:28.121 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T05:31:28.121 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T05:31:28.122 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T05:31:28.132 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2024-09-13T05:31:28.160 DEBUG:teuthology.parallel:result is None 2024-09-13T05:31:29.122 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-13T05:31:29.122 DEBUG:teuthology.orchestra.run.smithi139:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T05:31:29.206 INFO:teuthology.orchestra.run.smithi139.stdout:ttyS1 2024-09-13T05:31:29.234 DEBUG:teuthology.parallel:result is None 2024-09-13T05:31:29.234 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T05:31:29.241 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T05:31:29.241 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T05:31:29.244 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T05:31:29.249 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T05:31:29.352 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T05:31:29.362 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T05:31:29.362 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T05:31:29.364 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T05:31:29.385 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T05:31:29.391 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T05:31:29.391 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T05:31:29.423 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T05:31:29.444 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T05:31:29.454 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T05:31:29.460 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T05:31:29.469 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T05:31:29.471 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T05:31:29.477 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T05:31:29.478 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T05:31:29.499 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T05:31:29.533 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T05:31:29.542 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T05:31:29.542 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T05:31:29.563 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T05:31:29.581 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T05:31:29.614 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T05:31:29.662 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:31:29.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T05:31:29.725 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T05:31:29.731 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T05:31:29.777 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T05:31:29.777 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T05:31:29.837 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-09-13T05:31:29.839 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-09-13T05:31:29.916 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T05:31:29.923 INFO:teuthology.task.internal:Starting timer... 2024-09-13T05:31:29.923 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T05:31:29.933 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T05:31:29.944 DEBUG:teuthology.task.selinux:Excluding smithi079: OS 'ubuntu' does not support SELinux 2024-09-13T05:31:29.944 DEBUG:teuthology.task.selinux:Excluding smithi139: OS 'ubuntu' does not support SELinux 2024-09-13T05:31:29.944 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T05:31:29.944 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T05:31:29.944 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T05:31:29.944 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T05:31:29.953 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T05:31:29.965 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T05:31:29.966 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi079.front.sepia.ceph.com,smithi139.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T05:38:58.442 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com')] 2024-09-13T05:38:58.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-13T05:38:58.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:38:58.556 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-13T05:38:58.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-13T05:38:58.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T05:38:58.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:38:58.728 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-13T05:38:58.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T05:38:58.805 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T05:38:58.817 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T05:38:58.817 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T05:38:58.817 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T05:38:58.820 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T05:38:58.820 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T05:38:58.847 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T05:38:58.847 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: Command line: ntpd -gq 2024-09-13T05:38:58.847 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: ---------------------------------------------------- 2024-09-13T05:38:58.847 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T05:38:58.847 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T05:38:58.847 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: corporation. Support and training for ntp-4 are 2024-09-13T05:38:58.847 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: available at https://www.nwtime.org/support 2024-09-13T05:38:58.848 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: ---------------------------------------------------- 2024-09-13T05:38:58.848 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: proto: precision = 0.057 usec (-24) 2024-09-13T05:38:58.848 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: basedate set to 2022-02-04 2024-09-13T05:38:58.848 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: gps base set to 2022-02-06 (week 2196) 2024-09-13T05:38:58.848 INFO:teuthology.orchestra.run.smithi079.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T05:38:58.849 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T05:38:58.849 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T05:38:58.849 INFO:teuthology.orchestra.run.smithi079.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T05:38:58.851 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T05:38:58.851 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T05:38:58.851 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T05:38:58.851 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: Listen normally on 3 enp3s0f1 172.21.15.79:123 2024-09-13T05:38:58.851 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: Listen normally on 4 lo [::1]:123 2024-09-13T05:38:58.852 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce87%5]:123 2024-09-13T05:38:58.852 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:38:58 ntpd[18461]: Listening on routing socket on fd #22 for interface updates 2024-09-13T05:38:58.877 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T05:38:58.877 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: Command line: ntpd -gq 2024-09-13T05:38:58.877 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: ---------------------------------------------------- 2024-09-13T05:38:58.877 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T05:38:58.877 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T05:38:58.877 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: corporation. Support and training for ntp-4 are 2024-09-13T05:38:58.878 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: available at https://www.nwtime.org/support 2024-09-13T05:38:58.878 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: ---------------------------------------------------- 2024-09-13T05:38:58.879 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: proto: precision = 0.044 usec (-24) 2024-09-13T05:38:58.880 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: basedate set to 2022-02-04 2024-09-13T05:38:58.880 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: gps base set to 2022-02-06 (week 2196) 2024-09-13T05:38:58.880 INFO:teuthology.orchestra.run.smithi139.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T05:38:58.881 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T05:38:58.881 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T05:38:58.881 INFO:teuthology.orchestra.run.smithi139.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T05:38:58.882 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T05:38:58.883 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T05:38:58.883 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T05:38:58.883 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: Listen normally on 3 enp3s0f1 172.21.15.139:123 2024-09-13T05:38:58.883 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: Listen normally on 4 lo [::1]:123 2024-09-13T05:38:58.883 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f59%5]:123 2024-09-13T05:38:58.883 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:38:58 ntpd[18465]: Listening on routing socket on fd #22 for interface updates 2024-09-13T05:38:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:38:59 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:38:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:38:59 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:38:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:38:59 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:38:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:38:59 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:38:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:38:59 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:38:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:38:59 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:38:59.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:38:59 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:38:59.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:38:59 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:38:59.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:38:59 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:38:59.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:38:59 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:38:59.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:38:59 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:38:59.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:38:59 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:00 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:00 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:00 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:00 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:00 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:00 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:00 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:00 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:01.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:01 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:01.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:01 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:01.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:01 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:01.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:01 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:01.849 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:01 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:01.849 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:01 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:01.849 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:01 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:01.849 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:01 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:01.877 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:01 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:01.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:01 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:01.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:01 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:01.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:01 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:01.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:01 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:01.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:01 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:02 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:02 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:02 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:02 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:02 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:02 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:02.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:02 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:02.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:02 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:02.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:02 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:02.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:02 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:02.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:02 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:02.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:02 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:03.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:03 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:03.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:03 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:03.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:03 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:03.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:03 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:03.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:03 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:03.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:03 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:03 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:03 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:03 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:03 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:03 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:03 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:03.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:03 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:03.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:03 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:03.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:03 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:03.879 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:03 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:03.879 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:03 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:03.879 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:03 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:03.879 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:03 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:03.879 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:03 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:03.879 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:03 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:03.879 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:03 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:03.879 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:03 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:03.879 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:03 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:04.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:04 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:04.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:04 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:04.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:04 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:04.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:04 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:04.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:04 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:04.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:04 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:04.877 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:04 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:04.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:04 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:04.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:04 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:04.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:04 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:04.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:04 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:04.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:04 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:05.847 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:05 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:05.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:05 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:05.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:05 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:05.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:05 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:05.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:05 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:05.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:05 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:05.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:05 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:05.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:05 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:05.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:05 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:05.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:05 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:05.848 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:05 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:05.849 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:05 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:05.849 INFO:teuthology.orchestra.run.smithi079.stdout:13 Sep 05:39:05 ntpd[18461]: ntpd: time slew +0.000014 s 2024-09-13T05:39:05.849 INFO:teuthology.orchestra.run.smithi079.stdout:ntpd: time slew +0.000014s 2024-09-13T05:39:05.849 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:05 ntpd[18461]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T05:39:05.850 INFO:teuthology.orchestra.run.smithi079.stderr:13 Sep 05:39:05 ntpd[18461]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T05:39:05.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:05 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:05.878 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:05 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:05.879 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:05 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:05.879 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:05 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:05.879 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:05 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:05.880 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:05 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:05.880 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:05 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:05.880 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:05 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:05.880 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:05 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:39:05.880 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:05 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:39:05.880 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:05 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:39:05.880 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:05 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:39:05.881 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 05:39:05 ntpd[18465]: ntpd: time slew -0.000450 s 2024-09-13T05:39:05.881 INFO:teuthology.orchestra.run.smithi139.stdout:ntpd: time slew -0.000450s 2024-09-13T05:39:05.881 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:05 ntpd[18465]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T05:39:05.881 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 05:39:05 ntpd[18465]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T05:39:05.901 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T05:39:05.902 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2024-09-13T05:39:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T05:39:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T05:39:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T05:39:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T05:39:05.935 INFO:teuthology.orchestra.run.smithi139.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T05:39:05.935 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================== 2024-09-13T05:39:05.935 INFO:teuthology.orchestra.run.smithi139.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T05:39:05.935 INFO:teuthology.orchestra.run.smithi139.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T05:39:05.935 INFO:teuthology.orchestra.run.smithi139.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T05:39:05.935 INFO:teuthology.orchestra.run.smithi139.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T05:39:05.936 INFO:teuthology.run_tasks:Running task install... 2024-09-13T05:39:05.944 DEBUG:teuthology.task.install:project ceph 2024-09-13T05:39:05.944 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3'}} 2024-09-13T05:39:05.945 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3'} 2024-09-13T05:39:05.945 INFO:teuthology.task.install:Using flavor: default 2024-09-13T05:39:05.950 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T05:39:05.950 INFO:teuthology.task.install:extra packages: [] 2024-09-13T05:39:05.951 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-key list | grep Ceph 2024-09-13T05:39:05.951 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-key list | grep Ceph 2024-09-13T05:39:06.009 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T05:39:06.037 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T05:39:06.037 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T05:39:06.038 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T05:39:06.038 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 2024-09-13T05:39:06.054 INFO:teuthology.orchestra.run.smithi139.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T05:39:06.066 INFO:teuthology.orchestra.run.smithi139.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T05:39:06.066 INFO:teuthology.orchestra.run.smithi139.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T05:39:06.067 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T05:39:06.067 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 2024-09-13T05:39:06.193 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default/ 2024-09-13T05:39:06.193 INFO:teuthology.task.install.deb:Package version is 19.3.0-4911-g9d608eb1-1jammy 2024-09-13T05:39:06.218 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default/ 2024-09-13T05:39:06.218 INFO:teuthology.task.install.deb:Package version is 19.3.0-4911-g9d608eb1-1jammy 2024-09-13T05:39:06.322 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:39:06.322 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T05:39:06.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-13T05:39:06.340 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T05:39:06.340 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T05:39:06.354 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2024-09-13T05:39:06.522 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T05:39:06.557 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T05:39:06.579 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-13T05:39:06.580 INFO:teuthology.orchestra.run.smithi139.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T05:39:06.601 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T05:39:06.601 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-13T05:39:06.623 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,423 B] 2024-09-13T05:39:06.624 INFO:teuthology.orchestra.run.smithi139.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T05:39:06.629 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T05:39:06.651 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-13T05:39:06.656 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T05:39:06.657 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,423 B] 2024-09-13T05:39:06.664 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T05:39:06.685 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-13T05:39:06.705 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T05:39:06.728 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T05:39:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T05:39:06.809 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T05:39:06.923 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 29.3 kB in 0s (71.8 kB/s) 2024-09-13T05:39:07.037 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 29.3 kB in 0s (59.2 kB/s) 2024-09-13T05:39:07.898 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-13T05:39:07.915 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4911-g9d608eb1-1jammy cephadm=19.3.0-4911-g9d608eb1-1jammy ceph-mds=19.3.0-4911-g9d608eb1-1jammy ceph-mgr=19.3.0-4911-g9d608eb1-1jammy ceph-common=19.3.0-4911-g9d608eb1-1jammy ceph-fuse=19.3.0-4911-g9d608eb1-1jammy ceph-test=19.3.0-4911-g9d608eb1-1jammy ceph-volume=19.3.0-4911-g9d608eb1-1jammy radosgw=19.3.0-4911-g9d608eb1-1jammy python3-rados=19.3.0-4911-g9d608eb1-1jammy python3-rgw=19.3.0-4911-g9d608eb1-1jammy python3-cephfs=19.3.0-4911-g9d608eb1-1jammy python3-rbd=19.3.0-4911-g9d608eb1-1jammy libcephfs2=19.3.0-4911-g9d608eb1-1jammy libcephfs-dev=19.3.0-4911-g9d608eb1-1jammy librados2=19.3.0-4911-g9d608eb1-1jammy librbd1=19.3.0-4911-g9d608eb1-1jammy rbd-fuse=19.3.0-4911-g9d608eb1-1jammy 2024-09-13T05:39:07.969 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-13T05:39:08.065 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T05:39:08.310 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-13T05:39:08.310 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-13T05:39:08.311 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4911-g9d608eb1-1jammy cephadm=19.3.0-4911-g9d608eb1-1jammy ceph-mds=19.3.0-4911-g9d608eb1-1jammy ceph-mgr=19.3.0-4911-g9d608eb1-1jammy ceph-common=19.3.0-4911-g9d608eb1-1jammy ceph-fuse=19.3.0-4911-g9d608eb1-1jammy ceph-test=19.3.0-4911-g9d608eb1-1jammy ceph-volume=19.3.0-4911-g9d608eb1-1jammy radosgw=19.3.0-4911-g9d608eb1-1jammy python3-rados=19.3.0-4911-g9d608eb1-1jammy python3-rgw=19.3.0-4911-g9d608eb1-1jammy python3-cephfs=19.3.0-4911-g9d608eb1-1jammy python3-rbd=19.3.0-4911-g9d608eb1-1jammy libcephfs2=19.3.0-4911-g9d608eb1-1jammy libcephfs-dev=19.3.0-4911-g9d608eb1-1jammy librados2=19.3.0-4911-g9d608eb1-1jammy librbd1=19.3.0-4911-g9d608eb1-1jammy rbd-fuse=19.3.0-4911-g9d608eb1-1jammy 2024-09-13T05:39:08.339 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T05:39:08.339 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T05:39:08.339 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T05:39:08.339 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T05:39:08.340 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T05:39:08.340 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T05:39:08.340 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T05:39:08.341 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2024-09-13T05:39:08.341 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T05:39:08.341 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T05:39:08.341 INFO:teuthology.orchestra.run.smithi079.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-13T05:39:08.341 INFO:teuthology.orchestra.run.smithi079.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-13T05:39:08.341 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-13T05:39:08.342 INFO:teuthology.orchestra.run.smithi079.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-13T05:39:08.342 INFO:teuthology.orchestra.run.smithi079.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-13T05:39:08.342 INFO:teuthology.orchestra.run.smithi079.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-13T05:39:08.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-13T05:39:08.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-13T05:39:08.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-13T05:39:08.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-13T05:39:08.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-13T05:39:08.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-13T05:39:08.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-13T05:39:08.343 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T05:39:08.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-13T05:39:08.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-13T05:39:08.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T05:39:08.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T05:39:08.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T05:39:08.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T05:39:08.344 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T05:39:08.344 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet zip 2024-09-13T05:39:08.345 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2024-09-13T05:39:08.345 INFO:teuthology.orchestra.run.smithi079.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T05:39:08.345 INFO:teuthology.orchestra.run.smithi079.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T05:39:08.345 INFO:teuthology.orchestra.run.smithi079.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T05:39:08.345 INFO:teuthology.orchestra.run.smithi079.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T05:39:08.345 INFO:teuthology.orchestra.run.smithi079.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T05:39:08.345 INFO:teuthology.orchestra.run.smithi079.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T05:39:08.345 INFO:teuthology.orchestra.run.smithi079.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T05:39:08.345 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2024-09-13T05:39:08.345 INFO:teuthology.orchestra.run.smithi079.stdout: btrfs-tools 2024-09-13T05:39:08.377 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T05:39:08.446 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2024-09-13T05:39:08.446 INFO:teuthology.orchestra.run.smithi079.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T05:39:08.446 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T05:39:08.446 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T05:39:08.446 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T05:39:08.447 INFO:teuthology.orchestra.run.smithi079.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-13T05:39:08.447 INFO:teuthology.orchestra.run.smithi079.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T05:39:08.448 INFO:teuthology.orchestra.run.smithi079.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T05:39:08.448 INFO:teuthology.orchestra.run.smithi079.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T05:39:08.448 INFO:teuthology.orchestra.run.smithi079.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T05:39:08.448 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T05:39:08.448 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T05:39:08.448 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T05:39:08.448 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T05:39:08.448 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T05:39:08.448 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T05:39:08.448 INFO:teuthology.orchestra.run.smithi079.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T05:39:08.449 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T05:39:08.449 INFO:teuthology.orchestra.run.smithi079.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T05:39:08.449 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T05:39:08.449 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T05:39:08.449 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T05:39:08.449 INFO:teuthology.orchestra.run.smithi079.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T05:39:08.449 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T05:39:08.449 INFO:teuthology.orchestra.run.smithi079.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T05:39:08.449 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T05:39:08.449 INFO:teuthology.orchestra.run.smithi079.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T05:39:08.506 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T05:39:08.506 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 251 MB of archives. 2024-09-13T05:39:08.506 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-13T05:39:08.507 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T05:39:08.565 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-09-13T05:39:08.566 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-09-13T05:39:08.594 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T05:39:08.597 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T05:39:08.599 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4911-g9d608eb1-1jammy [3,634 kB] 2024-09-13T05:39:08.613 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T05:39:08.665 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T05:39:08.669 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T05:39:08.679 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T05:39:08.683 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-13T05:39:08.684 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T05:39:08.685 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T05:39:08.686 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T05:39:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T05:39:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T05:39:08.699 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T05:39:08.704 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T05:39:08.704 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T05:39:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T05:39:08.721 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T05:39:08.723 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T05:39:08.724 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T05:39:08.724 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T05:39:08.726 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T05:39:08.726 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T05:39:08.727 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T05:39:08.738 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T05:39:08.739 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T05:39:08.739 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T05:39:08.750 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T05:39:08.750 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T05:39:08.750 INFO:teuthology.orchestra.run.smithi139.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T05:39:08.750 INFO:teuthology.orchestra.run.smithi139.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T05:39:08.750 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T05:39:08.751 INFO:teuthology.orchestra.run.smithi139.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T05:39:08.751 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T05:39:08.752 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2024-09-13T05:39:08.752 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T05:39:08.752 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T05:39:08.752 INFO:teuthology.orchestra.run.smithi139.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-13T05:39:08.752 INFO:teuthology.orchestra.run.smithi139.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-13T05:39:08.752 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-13T05:39:08.753 INFO:teuthology.orchestra.run.smithi139.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-13T05:39:08.753 INFO:teuthology.orchestra.run.smithi139.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-13T05:39:08.753 INFO:teuthology.orchestra.run.smithi139.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-13T05:39:08.753 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-13T05:39:08.753 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-13T05:39:08.753 INFO:teuthology.orchestra.run.smithi139.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-13T05:39:08.754 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-13T05:39:08.754 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-13T05:39:08.754 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-13T05:39:08.754 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-13T05:39:08.754 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T05:39:08.754 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-13T05:39:08.754 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-13T05:39:08.754 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T05:39:08.754 INFO:teuthology.orchestra.run.smithi139.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T05:39:08.754 INFO:teuthology.orchestra.run.smithi139.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T05:39:08.754 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T05:39:08.754 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T05:39:08.754 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet zip 2024-09-13T05:39:08.755 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2024-09-13T05:39:08.755 INFO:teuthology.orchestra.run.smithi139.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T05:39:08.755 INFO:teuthology.orchestra.run.smithi139.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T05:39:08.755 INFO:teuthology.orchestra.run.smithi139.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T05:39:08.755 INFO:teuthology.orchestra.run.smithi139.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T05:39:08.755 INFO:teuthology.orchestra.run.smithi139.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T05:39:08.755 INFO:teuthology.orchestra.run.smithi139.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T05:39:08.755 INFO:teuthology.orchestra.run.smithi139.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T05:39:08.755 INFO:teuthology.orchestra.run.smithi139.stdout:Recommended packages: 2024-09-13T05:39:08.755 INFO:teuthology.orchestra.run.smithi139.stdout: btrfs-tools 2024-09-13T05:39:08.758 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T05:39:08.761 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T05:39:08.761 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T05:39:08.762 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T05:39:08.762 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T05:39:08.764 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T05:39:08.764 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T05:39:08.775 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T05:39:08.777 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T05:39:08.777 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T05:39:08.792 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T05:39:08.798 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T05:39:08.798 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T05:39:08.799 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T05:39:08.799 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T05:39:08.801 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T05:39:08.803 INFO:teuthology.orchestra.run.smithi079.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T05:39:08.811 INFO:teuthology.orchestra.run.smithi079.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T05:39:08.812 INFO:teuthology.orchestra.run.smithi079.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T05:39:08.813 INFO:teuthology.orchestra.run.smithi079.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T05:39:08.824 INFO:teuthology.orchestra.run.smithi079.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4911-g9d608eb1-1jammy [3,334 kB] 2024-09-13T05:39:08.828 INFO:teuthology.orchestra.run.smithi079.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T05:39:08.829 INFO:teuthology.orchestra.run.smithi079.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T05:39:08.836 INFO:teuthology.orchestra.run.smithi079.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T05:39:08.843 INFO:teuthology.orchestra.run.smithi079.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T05:39:08.860 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2024-09-13T05:39:08.860 INFO:teuthology.orchestra.run.smithi139.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T05:39:08.860 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T05:39:08.860 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T05:39:08.860 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T05:39:08.861 INFO:teuthology.orchestra.run.smithi139.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-13T05:39:08.861 INFO:teuthology.orchestra.run.smithi139.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T05:39:08.862 INFO:teuthology.orchestra.run.smithi139.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T05:39:08.862 INFO:teuthology.orchestra.run.smithi139.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T05:39:08.862 INFO:teuthology.orchestra.run.smithi139.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T05:39:08.862 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T05:39:08.862 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T05:39:08.862 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T05:39:08.863 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T05:39:08.863 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T05:39:08.863 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T05:39:08.863 INFO:teuthology.orchestra.run.smithi139.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T05:39:08.863 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T05:39:08.863 INFO:teuthology.orchestra.run.smithi139.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T05:39:08.863 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T05:39:08.863 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T05:39:08.863 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T05:39:08.863 INFO:teuthology.orchestra.run.smithi139.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T05:39:08.863 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T05:39:08.863 INFO:teuthology.orchestra.run.smithi139.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T05:39:08.863 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T05:39:08.863 INFO:teuthology.orchestra.run.smithi139.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T05:39:08.897 INFO:teuthology.orchestra.run.smithi079.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T05:39:08.898 INFO:teuthology.orchestra.run.smithi079.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T05:39:08.899 INFO:teuthology.orchestra.run.smithi079.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T05:39:08.900 INFO:teuthology.orchestra.run.smithi079.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T05:39:08.901 INFO:teuthology.orchestra.run.smithi079.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T05:39:08.918 INFO:teuthology.orchestra.run.smithi079.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T05:39:08.920 INFO:teuthology.orchestra.run.smithi079.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T05:39:08.920 INFO:teuthology.orchestra.run.smithi079.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T05:39:08.929 INFO:teuthology.orchestra.run.smithi079.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4911-g9d608eb1-1jammy [722 kB] 2024-09-13T05:39:08.935 INFO:teuthology.orchestra.run.smithi079.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T05:39:08.935 INFO:teuthology.orchestra.run.smithi079.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T05:39:08.936 INFO:teuthology.orchestra.run.smithi079.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T05:39:08.936 INFO:teuthology.orchestra.run.smithi079.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T05:39:08.937 INFO:teuthology.orchestra.run.smithi079.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T05:39:08.937 INFO:teuthology.orchestra.run.smithi079.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T05:39:08.940 INFO:teuthology.orchestra.run.smithi079.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4911-g9d608eb1-1jammy [356 kB] 2024-09-13T05:39:08.951 INFO:teuthology.orchestra.run.smithi079.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T05:39:08.951 INFO:teuthology.orchestra.run.smithi079.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T05:39:08.954 INFO:teuthology.orchestra.run.smithi079.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T05:39:08.968 INFO:teuthology.orchestra.run.smithi079.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T05:39:08.969 INFO:teuthology.orchestra.run.smithi079.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T05:39:08.970 INFO:teuthology.orchestra.run.smithi079.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T05:39:08.973 INFO:teuthology.orchestra.run.smithi079.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T05:39:08.975 INFO:teuthology.orchestra.run.smithi079.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T05:39:08.976 INFO:teuthology.orchestra.run.smithi079.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T05:39:08.976 INFO:teuthology.orchestra.run.smithi079.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T05:39:08.980 INFO:teuthology.orchestra.run.smithi079.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4911-g9d608eb1-1jammy [32.8 kB] 2024-09-13T05:39:08.985 INFO:teuthology.orchestra.run.smithi079.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T05:39:08.986 INFO:teuthology.orchestra.run.smithi079.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T05:39:08.988 INFO:teuthology.orchestra.run.smithi079.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T05:39:08.997 INFO:teuthology.orchestra.run.smithi079.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4911-g9d608eb1-1jammy [180 kB] 2024-09-13T05:39:09.002 INFO:teuthology.orchestra.run.smithi079.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T05:39:09.003 INFO:teuthology.orchestra.run.smithi079.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T05:39:09.003 INFO:teuthology.orchestra.run.smithi079.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T05:39:09.005 INFO:teuthology.orchestra.run.smithi079.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T05:39:09.005 INFO:teuthology.orchestra.run.smithi139.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T05:39:09.005 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 251 MB of archives. 2024-09-13T05:39:09.006 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-13T05:39:09.006 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4911-g9d608eb1-1jammy [3,634 kB] 2024-09-13T05:39:09.006 INFO:teuthology.orchestra.run.smithi079.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T05:39:09.011 INFO:teuthology.orchestra.run.smithi079.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T05:39:09.011 INFO:teuthology.orchestra.run.smithi079.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T05:39:09.019 INFO:teuthology.orchestra.run.smithi079.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T05:39:09.021 INFO:teuthology.orchestra.run.smithi079.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T05:39:09.022 INFO:teuthology.orchestra.run.smithi079.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T05:39:09.026 INFO:teuthology.orchestra.run.smithi079.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4911-g9d608eb1-1jammy [71.3 kB] 2024-09-13T05:39:09.034 INFO:teuthology.orchestra.run.smithi079.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4911-g9d608eb1-1jammy [338 kB] 2024-09-13T05:39:09.051 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T05:39:09.097 INFO:teuthology.orchestra.run.smithi079.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4911-g9d608eb1-1jammy [7,989 kB] 2024-09-13T05:39:09.250 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4911-g9d608eb1-1jammy [3,334 kB] 2024-09-13T05:39:09.289 INFO:teuthology.orchestra.run.smithi079.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4911-g9d608eb1-1jammy [112 kB] 2024-09-13T05:39:09.304 INFO:teuthology.orchestra.run.smithi079.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4911-g9d608eb1-1jammy [473 kB] 2024-09-13T05:39:09.325 INFO:teuthology.orchestra.run.smithi079.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4911-g9d608eb1-1jammy [28.3 MB] 2024-09-13T05:39:09.351 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4911-g9d608eb1-1jammy [722 kB] 2024-09-13T05:39:09.369 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4911-g9d608eb1-1jammy [356 kB] 2024-09-13T05:39:09.391 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4911-g9d608eb1-1jammy [32.8 kB] 2024-09-13T05:39:09.392 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4911-g9d608eb1-1jammy [180 kB] 2024-09-13T05:39:09.399 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4911-g9d608eb1-1jammy [71.3 kB] 2024-09-13T05:39:09.401 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4911-g9d608eb1-1jammy [338 kB] 2024-09-13T05:39:09.409 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4911-g9d608eb1-1jammy [7,989 kB] 2024-09-13T05:39:09.470 INFO:teuthology.orchestra.run.smithi139.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T05:39:09.482 INFO:teuthology.orchestra.run.smithi139.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T05:39:09.563 INFO:teuthology.orchestra.run.smithi139.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T05:39:09.699 INFO:teuthology.orchestra.run.smithi139.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4911-g9d608eb1-1jammy [112 kB] 2024-09-13T05:39:09.703 INFO:teuthology.orchestra.run.smithi139.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4911-g9d608eb1-1jammy [473 kB] 2024-09-13T05:39:09.718 INFO:teuthology.orchestra.run.smithi139.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4911-g9d608eb1-1jammy [28.3 MB] 2024-09-13T05:39:09.791 INFO:teuthology.orchestra.run.smithi139.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T05:39:09.803 INFO:teuthology.orchestra.run.smithi139.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T05:39:09.832 INFO:teuthology.orchestra.run.smithi139.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T05:39:09.841 INFO:teuthology.orchestra.run.smithi139.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-13T05:39:09.843 INFO:teuthology.orchestra.run.smithi139.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T05:39:09.844 INFO:teuthology.orchestra.run.smithi139.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T05:39:09.845 INFO:teuthology.orchestra.run.smithi139.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T05:39:09.862 INFO:teuthology.orchestra.run.smithi139.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T05:39:09.867 INFO:teuthology.orchestra.run.smithi139.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T05:39:09.873 INFO:teuthology.orchestra.run.smithi139.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T05:39:09.953 INFO:teuthology.orchestra.run.smithi139.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T05:39:09.953 INFO:teuthology.orchestra.run.smithi139.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T05:39:09.957 INFO:teuthology.orchestra.run.smithi139.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T05:39:09.962 INFO:teuthology.orchestra.run.smithi139.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T05:39:09.965 INFO:teuthology.orchestra.run.smithi139.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T05:39:09.967 INFO:teuthology.orchestra.run.smithi139.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T05:39:09.967 INFO:teuthology.orchestra.run.smithi139.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T05:39:09.970 INFO:teuthology.orchestra.run.smithi139.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T05:39:09.970 INFO:teuthology.orchestra.run.smithi139.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T05:39:10.035 INFO:teuthology.orchestra.run.smithi139.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T05:39:10.053 INFO:teuthology.orchestra.run.smithi139.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T05:39:10.053 INFO:teuthology.orchestra.run.smithi139.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T05:39:10.054 INFO:teuthology.orchestra.run.smithi139.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T05:39:10.055 INFO:teuthology.orchestra.run.smithi139.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T05:39:10.060 INFO:teuthology.orchestra.run.smithi139.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T05:39:10.118 INFO:teuthology.orchestra.run.smithi139.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T05:39:10.118 INFO:teuthology.orchestra.run.smithi139.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T05:39:10.119 INFO:teuthology.orchestra.run.smithi139.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T05:39:10.121 INFO:teuthology.orchestra.run.smithi139.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T05:39:10.198 INFO:teuthology.orchestra.run.smithi139.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T05:39:10.198 INFO:teuthology.orchestra.run.smithi139.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T05:39:10.201 INFO:teuthology.orchestra.run.smithi139.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T05:39:10.202 INFO:teuthology.orchestra.run.smithi139.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T05:39:10.203 INFO:teuthology.orchestra.run.smithi139.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T05:39:10.279 INFO:teuthology.orchestra.run.smithi139.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T05:39:10.279 INFO:teuthology.orchestra.run.smithi139.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T05:39:10.280 INFO:teuthology.orchestra.run.smithi139.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T05:39:10.282 INFO:teuthology.orchestra.run.smithi139.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T05:39:10.284 INFO:teuthology.orchestra.run.smithi139.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T05:39:10.360 INFO:teuthology.orchestra.run.smithi139.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T05:39:10.362 INFO:teuthology.orchestra.run.smithi139.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T05:39:10.364 INFO:teuthology.orchestra.run.smithi139.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T05:39:10.366 INFO:teuthology.orchestra.run.smithi139.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T05:39:10.370 INFO:teuthology.orchestra.run.smithi139.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T05:39:10.441 INFO:teuthology.orchestra.run.smithi139.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T05:39:10.443 INFO:teuthology.orchestra.run.smithi139.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T05:39:10.447 INFO:teuthology.orchestra.run.smithi139.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T05:39:10.563 INFO:teuthology.orchestra.run.smithi079.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4911-g9d608eb1-1jammy [5,210 kB] 2024-09-13T05:39:10.647 INFO:teuthology.orchestra.run.smithi079.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4911-g9d608eb1-1jammy [251 kB] 2024-09-13T05:39:10.648 INFO:teuthology.orchestra.run.smithi079.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4911-g9d608eb1-1jammy [124 kB] 2024-09-13T05:39:10.649 INFO:teuthology.orchestra.run.smithi079.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4911-g9d608eb1-1jammy [1,561 kB] 2024-09-13T05:39:10.650 INFO:teuthology.orchestra.run.smithi139.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4911-g9d608eb1-1jammy [5,210 kB] 2024-09-13T05:39:10.651 INFO:teuthology.orchestra.run.smithi139.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T05:39:10.653 INFO:teuthology.orchestra.run.smithi139.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T05:39:10.659 INFO:teuthology.orchestra.run.smithi139.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T05:39:10.659 INFO:teuthology.orchestra.run.smithi139.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T05:39:10.659 INFO:teuthology.orchestra.run.smithi139.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T05:39:10.675 INFO:teuthology.orchestra.run.smithi079.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4911-g9d608eb1-1jammy [6,309 kB] 2024-09-13T05:39:10.701 INFO:teuthology.orchestra.run.smithi139.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T05:39:10.702 INFO:teuthology.orchestra.run.smithi139.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T05:39:10.703 INFO:teuthology.orchestra.run.smithi139.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T05:39:10.722 INFO:teuthology.orchestra.run.smithi139.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4911-g9d608eb1-1jammy [251 kB] 2024-09-13T05:39:10.724 INFO:teuthology.orchestra.run.smithi139.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4911-g9d608eb1-1jammy [124 kB] 2024-09-13T05:39:10.726 INFO:teuthology.orchestra.run.smithi139.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4911-g9d608eb1-1jammy [1,561 kB] 2024-09-13T05:39:10.743 INFO:teuthology.orchestra.run.smithi139.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4911-g9d608eb1-1jammy [6,309 kB] 2024-09-13T05:39:10.768 INFO:teuthology.orchestra.run.smithi139.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T05:39:10.768 INFO:teuthology.orchestra.run.smithi139.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T05:39:10.818 INFO:teuthology.orchestra.run.smithi139.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T05:39:10.819 INFO:teuthology.orchestra.run.smithi139.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T05:39:10.820 INFO:teuthology.orchestra.run.smithi139.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T05:39:10.821 INFO:teuthology.orchestra.run.smithi139.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T05:39:10.821 INFO:teuthology.orchestra.run.smithi139.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T05:39:10.823 INFO:teuthology.orchestra.run.smithi139.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T05:39:10.830 INFO:teuthology.orchestra.run.smithi139.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T05:39:10.890 INFO:teuthology.orchestra.run.smithi079.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4911-g9d608eb1-1jammy [23.1 MB] 2024-09-13T05:39:10.899 INFO:teuthology.orchestra.run.smithi139.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T05:39:10.903 INFO:teuthology.orchestra.run.smithi139.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T05:39:10.904 INFO:teuthology.orchestra.run.smithi139.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T05:39:10.929 INFO:teuthology.orchestra.run.smithi139.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4911-g9d608eb1-1jammy [23.1 MB] 2024-09-13T05:39:10.981 INFO:teuthology.orchestra.run.smithi139.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T05:39:10.987 INFO:teuthology.orchestra.run.smithi139.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T05:39:10.989 INFO:teuthology.orchestra.run.smithi139.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T05:39:10.990 INFO:teuthology.orchestra.run.smithi139.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T05:39:11.001 INFO:teuthology.orchestra.run.smithi139.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T05:39:11.003 INFO:teuthology.orchestra.run.smithi139.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T05:39:11.011 INFO:teuthology.orchestra.run.smithi139.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T05:39:11.062 INFO:teuthology.orchestra.run.smithi139.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T05:39:11.063 INFO:teuthology.orchestra.run.smithi139.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T05:39:11.064 INFO:teuthology.orchestra.run.smithi139.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T05:39:11.143 INFO:teuthology.orchestra.run.smithi139.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T05:39:11.145 INFO:teuthology.orchestra.run.smithi139.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T05:39:11.162 INFO:teuthology.orchestra.run.smithi139.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T05:39:11.163 INFO:teuthology.orchestra.run.smithi139.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T05:39:11.164 INFO:teuthology.orchestra.run.smithi139.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T05:39:11.169 INFO:teuthology.orchestra.run.smithi139.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T05:39:11.171 INFO:teuthology.orchestra.run.smithi139.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T05:39:11.749 INFO:teuthology.orchestra.run.smithi139.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4911-g9d608eb1-1jammy [14.0 kB] 2024-09-13T05:39:11.770 INFO:teuthology.orchestra.run.smithi079.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4911-g9d608eb1-1jammy [14.0 kB] 2024-09-13T05:39:11.989 INFO:teuthology.orchestra.run.smithi079.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4911-g9d608eb1-1jammy [880 kB] 2024-09-13T05:39:11.993 INFO:teuthology.orchestra.run.smithi139.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4911-g9d608eb1-1jammy [880 kB] 2024-09-13T05:39:12.051 INFO:teuthology.orchestra.run.smithi079.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4911-g9d608eb1-1jammy [2,455 kB] 2024-09-13T05:39:12.052 INFO:teuthology.orchestra.run.smithi139.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4911-g9d608eb1-1jammy [2,455 kB] 2024-09-13T05:39:12.122 INFO:teuthology.orchestra.run.smithi139.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4911-g9d608eb1-1jammy [814 kB] 2024-09-13T05:39:12.128 INFO:teuthology.orchestra.run.smithi079.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4911-g9d608eb1-1jammy [814 kB] 2024-09-13T05:39:12.149 INFO:teuthology.orchestra.run.smithi139.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4911-g9d608eb1-1jammy [160 kB] 2024-09-13T05:39:12.150 INFO:teuthology.orchestra.run.smithi079.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4911-g9d608eb1-1jammy [160 kB] 2024-09-13T05:39:12.154 INFO:teuthology.orchestra.run.smithi079.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4911-g9d608eb1-1jammy [61.5 MB] 2024-09-13T05:39:12.154 INFO:teuthology.orchestra.run.smithi139.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4911-g9d608eb1-1jammy [61.5 MB] 2024-09-13T05:39:14.585 INFO:teuthology.orchestra.run.smithi139.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4911-g9d608eb1-1jammy [8,625 kB] 2024-09-13T05:39:14.681 INFO:teuthology.orchestra.run.smithi079.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4911-g9d608eb1-1jammy [8,625 kB] 2024-09-13T05:39:14.709 INFO:teuthology.orchestra.run.smithi139.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4911-g9d608eb1-1jammy [14.2 kB] 2024-09-13T05:39:14.709 INFO:teuthology.orchestra.run.smithi139.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4911-g9d608eb1-1jammy [55.8 MB] 2024-09-13T05:39:14.845 INFO:teuthology.orchestra.run.smithi079.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4911-g9d608eb1-1jammy [14.2 kB] 2024-09-13T05:39:14.845 INFO:teuthology.orchestra.run.smithi079.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4911-g9d608eb1-1jammy [55.8 MB] 2024-09-13T05:39:16.954 INFO:teuthology.orchestra.run.smithi139.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4911-g9d608eb1-1jammy [130 kB] 2024-09-13T05:39:16.956 INFO:teuthology.orchestra.run.smithi139.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4911-g9d608eb1-1jammy [39.0 kB] 2024-09-13T05:39:16.957 INFO:teuthology.orchestra.run.smithi139.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4911-g9d608eb1-1jammy [15.9 MB] 2024-09-13T05:39:17.126 INFO:teuthology.orchestra.run.smithi079.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4911-g9d608eb1-1jammy [130 kB] 2024-09-13T05:39:17.128 INFO:teuthology.orchestra.run.smithi079.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4911-g9d608eb1-1jammy [39.0 kB] 2024-09-13T05:39:17.129 INFO:teuthology.orchestra.run.smithi079.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4911-g9d608eb1-1jammy [15.9 MB] 2024-09-13T05:39:17.298 INFO:teuthology.orchestra.run.smithi139.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4911-g9d608eb1-1jammy [91.2 kB] 2024-09-13T05:39:17.472 INFO:teuthology.orchestra.run.smithi079.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4911-g9d608eb1-1jammy [91.2 kB] 2024-09-13T05:39:17.854 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 251 MB in 8s (29.8 MB/s) 2024-09-13T05:39:18.020 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T05:39:18.024 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 251 MB in 9s (27.8 MB/s) 2024-09-13T05:39:18.121 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T05:39:18.123 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T05:39:18.201 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T05:39:18.211 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T05:39:18.302 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T05:39:18.307 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T05:39:18.400 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T05:39:18.547 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T05:39:18.573 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T05:39:18.614 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T05:39:18.687 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T05:39:18.713 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T05:39:18.745 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T05:39:18.884 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T05:39:18.899 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T05:39:18.934 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T05:39:19.073 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T05:39:19.099 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T05:39:19.139 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T05:39:19.378 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T05:39:19.405 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T05:39:19.453 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T05:39:19.584 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T05:39:19.611 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T05:39:19.660 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T05:39:19.831 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T05:39:19.857 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T05:39:19.898 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T05:39:20.029 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T05:39:20.055 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T05:39:20.087 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T05:39:20.177 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T05:39:20.202 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T05:39:20.234 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T05:39:20.407 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T05:39:20.433 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T05:39:20.473 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T05:39:20.571 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T05:39:20.597 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T05:39:20.637 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T05:39:20.827 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T05:39:20.853 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T05:39:20.893 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T05:39:20.956 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librados2. 2024-09-13T05:39:20.983 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../007-librados2_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:21.023 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librados2 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:21.188 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librados2. 2024-09-13T05:39:21.214 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../007-librados2_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:21.254 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librados2 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:21.459 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libnbd0. 2024-09-13T05:39:21.475 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-13T05:39:21.509 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-13T05:39:21.690 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libnbd0. 2024-09-13T05:39:21.717 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-13T05:39:21.757 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-13T05:39:21.795 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librbd1. 2024-09-13T05:39:21.821 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../009-librbd1_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:21.862 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librbd1 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:22.068 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librbd1. 2024-09-13T05:39:22.094 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../009-librbd1_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:22.135 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librbd1 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:22.306 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T05:39:22.332 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:22.373 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libcephfs2 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:22.588 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T05:39:22.614 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:22.650 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rados. 2024-09-13T05:39:22.654 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs2 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:22.677 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:22.717 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rados (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:22.898 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rados. 2024-09-13T05:39:22.914 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:22.948 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rados (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:22.961 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T05:39:22.976 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:39:23.011 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-ceph-argparse (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:23.230 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T05:39:23.245 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:23.260 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T05:39:23.286 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:39:23.288 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cephfs (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:23.326 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-argparse (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:23.578 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T05:39:23.593 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:23.599 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T05:39:23.625 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:39:23.637 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cephfs (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:23.666 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-ceph-common (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:23.948 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T05:39:23.974 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:39:23.994 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T05:39:24.015 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-common (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:24.020 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T05:39:24.061 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T05:39:24.326 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T05:39:24.353 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T05:39:24.384 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T05:39:24.388 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T05:39:24.414 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T05:39:24.455 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T05:39:24.687 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T05:39:24.707 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T05:39:24.713 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T05:39:24.722 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:24.754 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T05:39:24.757 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rbd (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:24.998 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T05:39:25.024 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:25.064 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rbd (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:25.077 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T05:39:25.103 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T05:39:25.143 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T05:39:25.404 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T05:39:25.419 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T05:39:25.434 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T05:39:25.460 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T05:39:25.481 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T05:39:25.501 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T05:39:25.778 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T05:39:25.782 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T05:39:25.795 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T05:39:25.797 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T05:39:25.837 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T05:39:25.840 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T05:39:26.127 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package lua5.1. 2024-09-13T05:39:26.142 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T05:39:26.177 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T05:39:26.381 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T05:39:26.408 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T05:39:26.439 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T05:39:26.488 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package lua-any. 2024-09-13T05:39:26.503 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-13T05:39:26.546 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T05:39:26.785 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua5.1. 2024-09-13T05:39:26.790 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package zip. 2024-09-13T05:39:26.811 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T05:39:26.816 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-13T05:39:26.851 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T05:39:26.857 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T05:39:27.145 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-any. 2024-09-13T05:39:27.160 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-13T05:39:27.204 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T05:39:27.402 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package unzip. 2024-09-13T05:39:27.429 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T05:39:27.439 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package zip. 2024-09-13T05:39:27.455 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-13T05:39:27.469 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T05:39:27.489 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T05:39:27.768 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package unzip. 2024-09-13T05:39:27.794 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T05:39:27.834 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T05:39:27.839 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package luarocks. 2024-09-13T05:39:27.865 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T05:39:27.906 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T05:39:28.230 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package luarocks. 2024-09-13T05:39:28.256 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T05:39:28.280 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librgw2. 2024-09-13T05:39:28.296 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T05:39:28.306 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../026-librgw2_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:28.346 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librgw2 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:28.679 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librgw2. 2024-09-13T05:39:28.706 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../026-librgw2_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:28.745 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librgw2 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:28.957 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T05:39:28.980 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:29.024 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rgw (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:29.293 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T05:39:29.320 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T05:39:29.348 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T05:39:29.351 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T05:39:29.374 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:29.414 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rgw (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:29.688 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T05:39:29.714 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:29.734 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T05:39:29.754 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libradosstriper1 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:29.760 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T05:39:29.801 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T05:39:30.104 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T05:39:30.130 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:30.170 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libradosstriper1 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:30.191 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-common. 2024-09-13T05:39:30.217 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:30.257 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-common (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:30.599 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-common. 2024-09-13T05:39:30.625 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:30.665 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-common (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:31.681 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-base. 2024-09-13T05:39:31.707 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:31.757 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-base (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:32.164 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-base. 2024-09-13T05:39:32.188 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:32.238 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-base (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:32.318 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T05:39:32.345 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T05:39:32.410 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T05:39:32.688 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T05:39:32.714 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T05:39:32.754 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T05:39:32.808 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T05:39:32.834 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T05:39:32.868 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T05:39:33.049 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T05:39:33.065 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T05:39:33.099 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T05:39:33.171 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T05:39:33.198 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T05:39:33.237 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T05:39:33.368 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T05:39:33.394 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T05:39:33.434 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T05:39:33.557 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T05:39:33.584 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T05:39:33.624 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T05:39:33.754 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T05:39:33.780 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T05:39:33.821 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T05:39:33.927 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T05:39:33.954 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T05:39:33.994 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T05:39:34.124 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T05:39:34.351 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T05:39:34.351 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T05:39:34.351 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T05:39:34.351 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T05:39:34.352 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T05:39:34.443 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-portend. 2024-09-13T05:39:34.469 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-13T05:39:34.501 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T05:39:34.625 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T05:39:34.652 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T05:39:34.691 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T05:39:34.795 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T05:39:34.822 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T05:39:34.862 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T05:39:35.003 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-portend. 2024-09-13T05:39:35.030 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-13T05:39:35.069 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T05:39:35.165 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T05:39:35.191 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T05:39:35.231 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T05:39:35.348 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T05:39:35.375 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T05:39:35.414 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T05:39:35.568 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T05:39:35.594 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T05:39:35.634 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T05:39:35.734 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T05:39:35.760 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T05:39:35.800 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T05:39:35.946 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T05:39:35.972 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T05:39:36.012 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T05:39:36.197 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T05:39:36.324 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T05:39:36.324 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T05:39:36.324 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T05:39:36.342 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T05:39:36.382 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T05:39:36.533 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T05:39:36.559 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T05:39:36.599 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T05:39:36.659 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-mako. 2024-09-13T05:39:36.674 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T05:39:36.709 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T05:39:36.911 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T05:39:36.937 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T05:39:36.977 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T05:39:37.054 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T05:39:37.080 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T05:39:37.121 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T05:39:37.281 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-mako. 2024-09-13T05:39:37.307 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T05:39:37.347 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T05:39:37.423 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T05:39:37.450 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T05:39:37.495 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T05:39:37.667 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T05:39:37.694 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T05:39:37.734 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T05:39:37.959 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-webob. 2024-09-13T05:39:37.990 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T05:39:38.004 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T05:39:38.026 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T05:39:38.030 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T05:39:38.062 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T05:39:38.346 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T05:39:38.365 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webob. 2024-09-13T05:39:38.372 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T05:39:38.392 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T05:39:38.408 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T05:39:38.432 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T05:39:38.707 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T05:39:38.733 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T05:39:38.773 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T05:39:38.776 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T05:39:38.793 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T05:39:38.838 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T05:39:39.076 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-paste. 2024-09-13T05:39:39.102 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T05:39:39.105 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T05:39:39.120 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T05:39:39.142 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T05:39:39.154 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T05:39:39.420 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T05:39:39.436 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T05:39:39.441 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-paste. 2024-09-13T05:39:39.468 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T05:39:39.479 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T05:39:39.508 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T05:39:39.781 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T05:39:39.808 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T05:39:39.848 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T05:39:39.861 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T05:39:39.877 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T05:39:39.911 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T05:39:40.134 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T05:39:40.161 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T05:39:40.181 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T05:39:40.201 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T05:39:40.208 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T05:39:40.247 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T05:39:40.512 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T05:39:40.539 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T05:39:40.551 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T05:39:40.578 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T05:39:40.578 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T05:39:40.617 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T05:39:40.929 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T05:39:40.941 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T05:39:40.956 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T05:39:40.968 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T05:39:40.995 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T05:39:41.008 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T05:39:41.277 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-idna. 2024-09-13T05:39:41.300 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T05:39:41.344 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T05:39:41.351 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T05:39:41.378 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T05:39:41.417 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T05:39:41.663 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T05:39:41.690 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T05:39:41.721 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-idna. 2024-09-13T05:39:41.730 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T05:39:41.747 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T05:39:41.787 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T05:39:42.842 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-requests. 2024-09-13T05:39:42.869 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T05:39:42.908 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T05:39:43.007 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T05:39:43.034 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T05:39:43.076 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T05:39:43.211 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T05:39:43.238 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T05:39:43.280 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T05:39:43.419 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests. 2024-09-13T05:39:43.446 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T05:39:43.485 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T05:39:43.572 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T05:39:43.599 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:39:43.639 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:43.813 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T05:39:43.841 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T05:39:43.880 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T05:39:43.993 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T05:39:44.009 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:44.043 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:44.166 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T05:39:44.182 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:39:44.225 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:44.288 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T05:39:44.304 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T05:39:44.346 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T05:39:44.564 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T05:39:44.579 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:44.622 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:44.649 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T05:39:44.675 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T05:39:44.715 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T05:39:44.933 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T05:39:44.960 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T05:39:45.000 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T05:39:45.051 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T05:39:45.078 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:45.118 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:45.303 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T05:39:45.330 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T05:39:45.370 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T05:39:45.488 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T05:39:45.514 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:45.546 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mon (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:45.665 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T05:39:45.691 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:45.731 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:46.126 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T05:39:46.153 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:46.158 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T05:39:46.184 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:46.192 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mon (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:46.224 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-osd (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:47.055 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T05:39:47.082 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:47.113 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-osd (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:47.302 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph. 2024-09-13T05:39:47.329 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../067-ceph_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:47.377 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:47.696 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T05:39:47.723 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:47.906 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-fuse (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:48.192 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph. 2024-09-13T05:39:48.199 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T05:39:48.207 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../067-ceph_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:48.214 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:48.249 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mds (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:48.249 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:48.570 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T05:39:48.596 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:48.636 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-fuse (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:48.643 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package cephadm. 2024-09-13T05:39:48.670 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../070-cephadm_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:48.710 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking cephadm (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:48.989 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T05:39:49.016 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:49.030 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T05:39:49.048 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mds (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:49.056 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T05:39:49.096 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T05:39:49.415 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T05:39:49.426 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephadm. 2024-09-13T05:39:49.430 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T05:39:49.452 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../070-cephadm_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:39:49.473 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T05:39:49.492 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephadm (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:49.787 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T05:39:49.803 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T05:39:49.845 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T05:39:50.165 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T05:39:50.180 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T05:39:50.223 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T05:39:50.437 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-babel. 2024-09-13T05:39:50.464 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T05:39:50.503 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T05:39:50.814 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T05:39:50.841 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T05:39:50.880 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T05:39:51.217 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T05:39:51.243 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:39:51.283 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:51.312 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-babel. 2024-09-13T05:39:51.339 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T05:39:51.379 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T05:39:51.603 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T05:39:51.630 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T05:39:51.661 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T05:39:51.715 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T05:39:51.742 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T05:39:51.782 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T05:39:51.931 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-routes. 2024-09-13T05:39:51.957 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T05:39:51.997 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T05:39:52.136 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T05:39:52.163 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:39:52.193 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:52.292 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T05:39:52.319 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:39:52.350 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T05:39:52.550 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T05:39:52.580 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T05:39:52.875 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-routes. 2024-09-13T05:39:52.902 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T05:39:52.942 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T05:39:53.321 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T05:39:53.336 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:39:53.378 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:55.071 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T05:39:55.088 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T05:39:55.129 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T05:39:55.616 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T05:39:55.644 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T05:39:55.682 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T05:39:55.994 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T05:39:56.021 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T05:39:56.060 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T05:39:56.085 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T05:39:56.102 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T05:39:56.151 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T05:39:56.338 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T05:39:56.365 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T05:39:56.507 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T05:39:56.639 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T05:39:56.667 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T05:39:56.705 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T05:39:57.075 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T05:39:57.103 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T05:39:57.142 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T05:39:57.216 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T05:39:57.243 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:39:57.282 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:57.687 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T05:39:57.714 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T05:39:57.839 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T05:39:58.152 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T05:39:58.168 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T05:39:58.202 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T05:39:58.558 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T05:39:58.586 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:39:58.624 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:39:58.730 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T05:39:58.757 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T05:39:58.804 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T05:39:59.133 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T05:39:59.160 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T05:39:59.199 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T05:39:59.502 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T05:39:59.529 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-13T05:39:59.568 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T05:39:59.619 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T05:39:59.646 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T05:39:59.686 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T05:39:59.881 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T05:39:59.908 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T05:39:59.947 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T05:39:59.989 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T05:40:00.016 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T05:40:00.055 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T05:40:00.233 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T05:40:00.249 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T05:40:00.283 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T05:40:00.401 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T05:40:00.429 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T05:40:00.469 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T05:40:00.502 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T05:40:00.518 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T05:40:00.561 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T05:40:00.779 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T05:40:00.807 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-13T05:40:00.846 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T05:40:00.881 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T05:40:00.908 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T05:40:00.947 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T05:40:01.175 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T05:40:01.202 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T05:40:01.241 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T05:40:01.570 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T05:40:01.598 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T05:40:01.610 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T05:40:01.627 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:40:01.636 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T05:40:01.669 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:01.948 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T05:40:01.976 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T05:40:01.997 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T05:40:02.014 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T05:40:02.024 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T05:40:02.063 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T05:40:02.310 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T05:40:02.337 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T05:40:02.341 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T05:40:02.365 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T05:40:02.368 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T05:40:02.399 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T05:40:02.652 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package jq. 2024-09-13T05:40:02.679 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T05:40:02.720 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T05:40:02.996 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package socat. 2024-09-13T05:40:03.012 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T05:40:03.024 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T05:40:03.041 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:40:03.054 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T05:40:03.163 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:03.399 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T05:40:03.415 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T05:40:03.448 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T05:40:03.519 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T05:40:03.547 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T05:40:03.585 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T05:40:03.786 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-test. 2024-09-13T05:40:03.802 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:40:03.844 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-test (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:03.922 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T05:40:03.949 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T05:40:03.988 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T05:40:04.249 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package jq. 2024-09-13T05:40:04.274 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T05:40:04.316 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T05:40:04.578 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package socat. 2024-09-13T05:40:04.594 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T05:40:04.661 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T05:40:04.956 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T05:40:04.973 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T05:40:05.006 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T05:40:05.419 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-test. 2024-09-13T05:40:05.448 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:40:05.477 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-test (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:06.307 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T05:40:06.323 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:40:06.356 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-volume (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:06.643 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T05:40:06.660 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:40:06.701 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libcephfs-dev (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:06.971 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T05:40:06.999 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T05:40:07.037 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T05:40:07.367 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T05:40:07.395 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T05:40:07.433 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T05:40:07.798 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T05:40:07.826 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T05:40:07.864 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T05:40:08.065 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T05:40:08.094 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4911-g9d608eb1-1jammy_all.deb ... 2024-09-13T05:40:08.132 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-volume (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:08.277 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package pkg-config. 2024-09-13T05:40:08.306 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T05:40:08.343 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T05:40:08.469 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T05:40:08.494 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:40:08.536 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs-dev (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:08.605 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T05:40:08.621 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T05:40:08.663 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T05:40:08.856 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T05:40:08.884 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T05:40:08.922 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T05:40:09.270 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T05:40:09.540 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T05:40:09.541 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T05:40:09.541 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T05:40:09.541 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T05:40:09.541 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T05:40:09.669 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T05:40:09.697 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T05:40:09.698 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T05:40:09.727 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T05:40:09.735 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T05:40:09.764 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T05:40:10.072 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T05:40:10.101 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T05:40:10.138 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T05:40:10.188 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package pkg-config. 2024-09-13T05:40:10.216 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T05:40:10.253 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T05:40:10.416 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T05:40:10.445 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T05:40:10.474 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T05:40:10.498 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T05:40:10.515 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T05:40:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T05:40:10.810 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-py. 2024-09-13T05:40:10.838 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-13T05:40:10.877 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T05:40:11.010 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T05:40:11.038 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T05:40:11.077 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T05:40:11.222 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T05:40:11.250 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T05:40:11.288 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T05:40:11.329 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T05:40:11.346 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T05:40:11.379 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T05:40:11.675 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T05:40:11.703 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T05:40:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T05:40:11.742 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T05:40:11.770 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T05:40:11.809 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T05:40:12.111 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-toml. 2024-09-13T05:40:12.112 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T05:40:12.139 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T05:40:12.140 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-13T05:40:12.178 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T05:40:12.178 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T05:40:12.464 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T05:40:12.489 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-py. 2024-09-13T05:40:12.492 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T05:40:12.517 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-13T05:40:12.533 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T05:40:12.547 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T05:40:12.868 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T05:40:12.875 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T05:40:12.896 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T05:40:12.904 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T05:40:12.937 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T05:40:12.942 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T05:40:13.211 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T05:40:13.227 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T05:40:13.269 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T05:40:13.458 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T05:40:13.486 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T05:40:13.524 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T05:40:13.844 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-toml. 2024-09-13T05:40:13.872 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-13T05:40:13.902 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T05:40:14.031 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package radosgw. 2024-09-13T05:40:14.060 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../117-radosgw_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:40:14.098 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking radosgw (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:14.197 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T05:40:14.226 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T05:40:14.263 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T05:40:14.576 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T05:40:14.592 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T05:40:14.626 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T05:40:14.870 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T05:40:14.886 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T05:40:14.928 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T05:40:14.942 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T05:40:14.958 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:40:14.992 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking rbd-fuse (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:15.297 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T05:40:15.555 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T05:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T05:40:15.725 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package radosgw. 2024-09-13T05:40:15.753 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../117-radosgw_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:40:15.782 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking radosgw (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:15.938 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T05:40:16.288 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T05:40:16.728 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T05:40:16.756 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4911-g9d608eb1-1jammy_amd64.deb ... 2024-09-13T05:40:16.758 INFO:teuthology.orchestra.run.smithi139.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T05:40:16.794 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking rbd-fuse (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:16.825 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up cephadm (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:17.107 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T05:40:17.341 INFO:teuthology.orchestra.run.smithi139.stdout:Adding system user cephadm....done 2024-09-13T05:40:17.358 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T05:40:17.484 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T05:40:17.498 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T05:40:17.748 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T05:40:17.774 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T05:40:18.033 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T05:40:18.104 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T05:40:18.159 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T05:40:18.410 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T05:40:18.548 INFO:teuthology.orchestra.run.smithi079.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T05:40:18.645 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephadm (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:18.653 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T05:40:18.779 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T05:40:19.106 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T05:40:19.194 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user cephadm....done 2024-09-13T05:40:19.309 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T05:40:19.474 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T05:40:19.578 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T05:40:19.725 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T05:40:19.829 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T05:40:19.931 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T05:40:19.993 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T05:40:20.165 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T05:40:20.244 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T05:40:20.416 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T05:40:20.512 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T05:40:20.542 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T05:40:20.780 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T05:40:20.844 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T05:40:21.086 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-ceph-argparse (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:21.196 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T05:40:21.357 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T05:40:21.464 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T05:40:21.482 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-13T05:40:21.609 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T05:40:21.718 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T05:40:21.724 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T05:40:21.827 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T05:40:21.976 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T05:40:22.078 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T05:40:22.219 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T05:40:22.453 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T05:40:22.484 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T05:40:22.517 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T05:40:22.581 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T05:40:22.707 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T05:40:22.729 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-argparse (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:23.067 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T05:40:23.131 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T05:40:23.185 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T05:40:23.257 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-13T05:40:23.383 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T05:40:23.444 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T05:40:23.526 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T05:40:23.677 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T05:40:23.703 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T05:40:23.936 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T05:40:24.013 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T05:40:24.308 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T05:40:24.342 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T05:40:24.407 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T05:40:24.460 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T05:40:24.533 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T05:40:24.892 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T05:40:25.010 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T05:40:25.166 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T05:40:25.262 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T05:40:25.417 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T05:40:25.521 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T05:40:25.534 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T05:40:25.643 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T05:40:25.814 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T05:40:25.928 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T05:40:25.940 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T05:40:26.321 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T05:40:26.572 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T05:40:26.609 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T05:40:26.860 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T05:40:26.940 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T05:40:26.978 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T05:40:27.104 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T05:40:27.216 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T05:40:27.405 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T05:40:27.542 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T05:40:27.773 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T05:40:27.801 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T05:40:27.928 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-ceph-common (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:28.016 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T05:40:28.229 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T05:40:28.534 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T05:40:28.547 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T05:40:28.836 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T05:40:29.171 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T05:40:29.422 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T05:40:29.548 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-common (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:29.719 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T05:40:29.849 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T05:40:29.971 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T05:40:30.105 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T05:40:30.167 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T05:40:30.381 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T05:40:30.507 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T05:40:30.624 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T05:40:30.901 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T05:40:31.143 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T05:40:31.333 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T05:40:31.386 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T05:40:31.528 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T05:40:31.584 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T05:40:31.710 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T05:40:31.839 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T05:40:31.961 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T05:40:32.062 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T05:40:32.098 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T05:40:32.163 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T05:40:32.365 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T05:40:32.465 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T05:40:32.617 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T05:40:32.724 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T05:40:32.851 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T05:40:32.975 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T05:40:33.102 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T05:40:33.110 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T05:40:33.221 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T05:40:33.412 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T05:40:33.504 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T05:40:33.630 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T05:40:33.671 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T05:40:33.923 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T05:40:33.931 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T05:40:34.182 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T05:40:34.224 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T05:40:34.450 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T05:40:34.466 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T05:40:34.567 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T05:40:34.693 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T05:40:34.709 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T05:40:34.782 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T05:40:34.844 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T05:40:35.053 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T05:40:35.129 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T05:40:35.198 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T05:40:35.260 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T05:40:35.548 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T05:40:35.589 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T05:40:35.865 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T05:40:35.865 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T05:40:35.991 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T05:40:36.125 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T05:40:36.242 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T05:40:36.251 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T05:40:36.359 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T05:40:36.385 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T05:40:36.474 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T05:40:36.677 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T05:40:36.704 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T05:40:36.805 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T05:40:36.970 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T05:40:37.223 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T05:40:37.254 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T05:40:37.380 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T05:40:37.491 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T05:40:37.642 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T05:40:37.664 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T05:40:37.893 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T05:40:38.018 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T05:40:38.019 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T05:40:38.277 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T05:40:38.329 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T05:40:38.614 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T05:40:38.646 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T05:40:38.882 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T05:40:38.947 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T05:40:39.033 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T05:40:39.291 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T05:40:39.292 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T05:40:39.409 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librados2 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:39.518 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:39.627 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T05:40:39.654 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T05:40:39.897 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T05:40:40.005 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libcephfs2 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:40.131 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libradosstriper1 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:40.257 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T05:40:40.283 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T05:40:40.534 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librbd1 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:40.559 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T05:40:40.676 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-modules-core (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:40.802 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-fuse (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:40.904 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T05:40:41.017 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T05:40:41.018 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T05:40:41.030 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librados2 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:41.156 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:41.282 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T05:40:41.520 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libcephfs-dev (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:41.603 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs2 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:41.655 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rados (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:41.704 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libradosstriper1 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:41.780 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librgw2 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:41.805 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T05:40:41.906 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T05:40:42.081 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librbd1 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:42.208 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-modules-core (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:42.325 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-fuse (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:42.519 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T05:40:42.519 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T05:40:42.960 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs-dev (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:43.095 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rados (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:43.143 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rbd (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:43.221 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librgw2 (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:43.269 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up rbd-fuse (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:43.347 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T05:40:43.395 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rgw (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:43.529 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cephfs (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:43.655 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-common (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:44.207 INFO:teuthology.orchestra.run.smithi139.stdout:Adding group ceph....done 2024-09-13T05:40:44.576 INFO:teuthology.orchestra.run.smithi139.stdout:Adding system user ceph....done 2024-09-13T05:40:44.576 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rbd (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:44.710 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up rbd-fuse (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:44.742 INFO:teuthology.orchestra.run.smithi139.stdout:Setting system user ceph properties....done 2024-09-13T05:40:44.758 INFO:teuthology.orchestra.run.smithi139.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T05:40:44.811 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rgw (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:44.905 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T05:40:44.912 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cephfs (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:45.039 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-common (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:45.256 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T05:40:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:Adding group ceph....done 2024-09-13T05:40:45.723 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-test (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:45.849 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up radosgw (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:45.976 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user ceph....done 2024-09-13T05:40:46.144 INFO:teuthology.orchestra.run.smithi079.stdout:Setting system user ceph properties....done 2024-09-13T05:40:46.160 INFO:teuthology.orchestra.run.smithi079.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T05:40:46.294 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T05:40:46.302 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T05:40:46.303 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T05:40:46.602 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T05:40:46.759 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-base (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:47.101 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T05:40:47.107 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-test (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:47.233 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up radosgw (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:47.594 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mds (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:47.647 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T05:40:47.647 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T05:40:47.834 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T05:40:47.834 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T05:40:48.127 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-base (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:48.346 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:48.442 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T05:40:48.553 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T05:40:48.553 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T05:40:48.913 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mds (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:49.057 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-osd (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:49.131 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T05:40:49.131 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T05:40:49.435 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T05:40:49.436 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T05:40:49.648 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:49.888 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T05:40:49.889 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T05:40:49.933 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:50.394 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:50.508 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-osd (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:50.570 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mon (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:50.778 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T05:40:50.779 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T05:40:50.785 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T05:40:50.785 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T05:40:51.269 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:51.271 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-cephadm (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:51.395 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:51.414 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:51.546 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mon (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:51.623 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-dashboard (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:51.759 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T05:40:51.759 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T05:40:51.766 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-volume (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:52.119 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T05:40:52.220 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T05:40:52.240 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-cephadm (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:52.381 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T05:40:52.390 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:52.516 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-dashboard (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:52.667 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-volume (19.3.0-4911-g9d608eb1-1jammy) ... 2024-09-13T05:40:53.129 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T05:40:53.155 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T05:40:53.230 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T05:40:53.382 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T05:40:53.813 INFO:teuthology.orchestra.run.smithi139.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T05:40:53.819 DEBUG:teuthology.parallel:result is None 2024-09-13T05:40:54.493 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T05:40:55.171 INFO:teuthology.orchestra.run.smithi079.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T05:40:55.177 DEBUG:teuthology.parallel:result is None 2024-09-13T05:40:55.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 2024-09-13T05:40:55.333 DEBUG:teuthology.orchestra.run.smithi079:> dpkg-query -W -f '${Version}' ceph 2024-09-13T05:40:55.352 INFO:teuthology.orchestra.run.smithi079.stdout:19.3.0-4911-g9d608eb1-1jammy 2024-09-13T05:40:55.353 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4911-g9d608eb1-1jammy 2024-09-13T05:40:55.353 INFO:teuthology.task.install:The correct ceph version 19.3.0-4911-g9d608eb1-1jammy is installed. 2024-09-13T05:40:55.354 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 2024-09-13T05:40:55.501 DEBUG:teuthology.orchestra.run.smithi139:> dpkg-query -W -f '${Version}' ceph 2024-09-13T05:40:55.520 INFO:teuthology.orchestra.run.smithi139.stdout:19.3.0-4911-g9d608eb1-1jammy 2024-09-13T05:40:55.520 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4911-g9d608eb1-1jammy 2024-09-13T05:40:55.521 INFO:teuthology.task.install:The correct ceph version 19.3.0-4911-g9d608eb1-1jammy is installed. 2024-09-13T05:40:55.524 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T05:40:55.525 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:40:55.525 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T05:40:55.540 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T05:40:55.540 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T05:40:55.576 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T05:40:55.576 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:40:55.576 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T05:40:55.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T05:40:55.656 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T05:40:55.656 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T05:40:55.669 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T05:40:55.722 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T05:40:55.723 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:40:55.723 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T05:40:55.736 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T05:40:55.791 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T05:40:55.791 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T05:40:55.804 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T05:40:55.859 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T05:40:55.860 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:40:55.860 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T05:40:55.873 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T05:40:55.928 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T05:40:55.928 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T05:40:55.944 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T05:40:55.999 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T05:40:56.095 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', 'CEPHADM_STRAY_DAEMON'], 'log-only-match': ['CEPHADM_'], 'sha1': '9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3', 'cephadm_mode': 'root'} 2024-09-13T05:40:56.096 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 2024-09-13T05:40:56.096 INFO:tasks.cephadm:Cluster fsid is bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:40:56.096 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T05:40:56.096 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.79', 'mon.c': '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]', 'mon.b': '172.21.15.139'} 2024-09-13T05:40:56.097 INFO:tasks.cephadm:First mon is mon.a on smithi079 2024-09-13T05:40:56.097 INFO:tasks.cephadm:First mgr is y 2024-09-13T05:40:56.097 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T05:40:56.097 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname $(hostname -s) 2024-09-13T05:40:56.112 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname $(hostname -s) 2024-09-13T05:40:56.126 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-13T05:40:56.126 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 2024-09-13T05:40:56.276 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic/83020/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4911-g9d608eb1', 'node_name': '172.21.2.12+braggi12', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4911-g9d608eb1-1jammy'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default/', 'distro_codename': 'jammy', 'modified': '2024-09-12 22:30:02.539717', 'distro_version': '22.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-guits-main-2024-09-12-1245', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}] 2024-09-13T05:40:56.419 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-guits-main-2024-09-12-1245, sha1 9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 from https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu%2F22.04%2Fx86_64&flavor=default&sha1=9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 2024-09-13T05:40:56.421 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-13T05:40:56.421 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-13T05:40:56.421 DEBUG:teuthology.orchestra.run.smithi079:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T05:40:56.863 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-rw-r-- 1 ubuntu ubuntu 811890 Sep 13 05:40 /home/ubuntu/cephtest/cephadm 2024-09-13T05:40:56.864 DEBUG:teuthology.orchestra.run.smithi139:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-guits-main-2024-09-12-1245/9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T05:40:57.306 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-rw-r-- 1 ubuntu ubuntu 811890 Sep 13 05:40 /home/ubuntu/cephtest/cephadm 2024-09-13T05:40:57.307 DEBUG:teuthology.orchestra.run.smithi079:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T05:40:57.315 DEBUG:teuthology.orchestra.run.smithi139:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T05:40:57.334 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 on all hosts... 2024-09-13T05:40:57.334 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 pull 2024-09-13T05:40:57.361 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 pull 2024-09-13T05:40:57.544 INFO:teuthology.orchestra.run.smithi079.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3... 2024-09-13T05:40:57.550 INFO:teuthology.orchestra.run.smithi139.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3... 2024-09-13T05:41:55.193 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-13T05:41:55.194 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.3.0-4911-g9d608eb1 (9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3) squid (dev)", 2024-09-13T05:41:55.194 INFO:teuthology.orchestra.run.smithi079.stdout: "image_id": "0ce38589d192f00a67c8f9b0cb5ac7ff2f64a4d81462c062375b6ecefcaf776f", 2024-09-13T05:41:55.194 INFO:teuthology.orchestra.run.smithi079.stdout: "repo_digests": [ 2024-09-13T05:41:55.194 INFO:teuthology.orchestra.run.smithi079.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:931e75f8a8ba7bd669ee47053a4500e7d74632603919af8ba169df149fde6cff" 2024-09-13T05:41:55.195 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-13T05:41:55.195 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-13T05:41:57.807 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T05:41:57.807 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 19.3.0-4911-g9d608eb1 (9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3) squid (dev)", 2024-09-13T05:41:57.807 INFO:teuthology.orchestra.run.smithi139.stdout: "image_id": "0ce38589d192f00a67c8f9b0cb5ac7ff2f64a4d81462c062375b6ecefcaf776f", 2024-09-13T05:41:57.807 INFO:teuthology.orchestra.run.smithi139.stdout: "repo_digests": [ 2024-09-13T05:41:57.807 INFO:teuthology.orchestra.run.smithi139.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:931e75f8a8ba7bd669ee47053a4500e7d74632603919af8ba169df149fde6cff" 2024-09-13T05:41:57.807 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T05:41:57.807 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T05:41:57.852 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph 2024-09-13T05:41:57.867 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph 2024-09-13T05:41:57.882 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /etc/ceph 2024-09-13T05:41:57.923 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /etc/ceph 2024-09-13T05:41:57.937 INFO:tasks.cephadm:Writing seed config... 2024-09-13T05:41:57.939 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T05:41:57.939 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T05:41:57.939 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T05:41:57.939 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-09-13T05:41:57.939 INFO:tasks.cephadm: override: [global] ms bind msgr1 = False 2024-09-13T05:41:57.939 INFO:tasks.cephadm: override: [global] ms bind msgr2 = True 2024-09-13T05:41:57.939 INFO:tasks.cephadm: override: [global] ms type = async 2024-09-13T05:41:57.939 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T05:41:57.939 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T05:41:57.939 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T05:41:57.939 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T05:41:57.939 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T05:41:57.940 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T05:41:57.940 INFO:tasks.cephadm: override: [osd] osd class default list = * 2024-09-13T05:41:57.940 INFO:tasks.cephadm: override: [osd] osd class load list = * 2024-09-13T05:41:57.940 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-13T05:41:57.940 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:41:57.940 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T05:41:57.975 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = bf551932-7192-11ef-bceb-c7b262605968 mon election default strategy = 3 ms bind msgr1 = False ms bind msgr2 = True ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2024-09-13T05:41:57.976 DEBUG:teuthology.orchestra.run.smithi079:mon.a> sudo journalctl -f -n 0 -u ceph-bf551932-7192-11ef-bceb-c7b262605968@mon.a.service 2024-09-13T05:41:58.021 DEBUG:teuthology.orchestra.run.smithi079:mgr.y> sudo journalctl -f -n 0 -u ceph-bf551932-7192-11ef-bceb-c7b262605968@mgr.y.service 2024-09-13T05:41:58.068 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T05:41:58.068 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 -v bootstrap --fsid bf551932-7192-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.79 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T05:41:58.291 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-13T05:41:58.291 INFO:teuthology.orchestra.run.smithi079.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3', '-v', 'bootstrap', '--fsid', 'bf551932-7192-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.79', '--skip-admin-label'] 2024-09-13T05:41:58.292 INFO:teuthology.orchestra.run.smithi079.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T05:41:58.293 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying podman|docker is present... 2024-09-13T05:41:58.293 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying lvm2 is present... 2024-09-13T05:41:58.293 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying time synchronization is in place... 2024-09-13T05:41:58.297 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T05:41:58.297 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T05:41:58.303 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T05:41:58.303 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-13T05:41:58.308 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-13T05:41:58.308 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-13T05:41:58.311 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-13T05:41:58.311 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-13T05:41:58.315 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-13T05:41:58.315 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout masked 2024-09-13T05:41:58.318 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-13T05:41:58.318 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-13T05:41:58.322 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-13T05:41:58.322 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-13T05:41:58.327 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-13T05:41:58.327 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-13T05:41:58.330 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout enabled 2024-09-13T05:41:58.335 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout active 2024-09-13T05:41:58.335 INFO:teuthology.orchestra.run.smithi079.stdout:Unit ntp.service is enabled and running 2024-09-13T05:41:58.335 INFO:teuthology.orchestra.run.smithi079.stdout:Repeating the final host check... 2024-09-13T05:41:58.335 INFO:teuthology.orchestra.run.smithi079.stdout:docker (/usr/bin/docker) is present 2024-09-13T05:41:58.335 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl is present 2024-09-13T05:41:58.335 INFO:teuthology.orchestra.run.smithi079.stdout:lvcreate is present 2024-09-13T05:41:58.338 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T05:41:58.338 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T05:41:58.343 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T05:41:58.343 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-13T05:41:58.347 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-13T05:41:58.347 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-13T05:41:58.351 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-13T05:41:58.351 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-13T05:41:58.354 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-13T05:41:58.354 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout masked 2024-09-13T05:41:58.357 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-13T05:41:58.357 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-13T05:41:58.361 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-13T05:41:58.361 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-13T05:41:58.364 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-13T05:41:58.365 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-13T05:41:58.368 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout enabled 2024-09-13T05:41:58.373 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout active 2024-09-13T05:41:58.373 INFO:teuthology.orchestra.run.smithi079.stdout:Unit ntp.service is enabled and running 2024-09-13T05:41:58.373 INFO:teuthology.orchestra.run.smithi079.stdout:Host looks OK 2024-09-13T05:41:58.373 INFO:teuthology.orchestra.run.smithi079.stdout:Cluster fsid: bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:41:58.373 INFO:teuthology.orchestra.run.smithi079.stdout:Acquiring lock 140409664005808 on /run/cephadm/bf551932-7192-11ef-bceb-c7b262605968.lock 2024-09-13T05:41:58.373 INFO:teuthology.orchestra.run.smithi079.stdout:Lock 140409664005808 acquired on /run/cephadm/bf551932-7192-11ef-bceb-c7b262605968.lock 2024-09-13T05:41:58.373 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying IP 172.21.15.79 port 3300 ... 2024-09-13T05:41:58.373 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying IP 172.21.15.79 port 6789 ... 2024-09-13T05:41:58.374 INFO:teuthology.orchestra.run.smithi079.stdout:Base mon IP(s) is [172.21.15.79:3300, 172.21.15.79:6789], mon addrv is [v2:172.21.15.79:3300,v1:172.21.15.79:6789] 2024-09-13T05:41:58.376 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 2024-09-13T05:41:58.376 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.79 metric 100 2024-09-13T05:41:58.376 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout 158.69.67.47 via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.79 metric 100 2024-09-13T05:41:58.376 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-09-13T05:41:58.377 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.79 metric 100 2024-09-13T05:41:58.377 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout 172.21.0.1 dev enp3s0f1 proto dhcp scope link src 172.21.15.79 metric 100 2024-09-13T05:41:58.377 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout 172.21.0.2 dev enp3s0f1 proto dhcp scope link src 172.21.15.79 metric 100 2024-09-13T05:41:58.378 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.79 metric 100 2024-09-13T05:41:58.378 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T05:41:58.378 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-09-13T05:41:58.378 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 expires 1783sec pref medium 2024-09-13T05:41:58.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T05:41:58.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T05:41:58.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T05:41:58.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-13T05:41:58.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-09-13T05:41:58.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T05:41:58.382 INFO:teuthology.orchestra.run.smithi079.stdout:Mon IP `172.21.15.79` is in CIDR network `172.21.0.0/20` 2024-09-13T05:41:58.382 INFO:teuthology.orchestra.run.smithi079.stdout:Mon IP `172.21.15.79` is in CIDR network `172.21.0.0/20` 2024-09-13T05:41:58.382 INFO:teuthology.orchestra.run.smithi079.stdout:Mon IP `172.21.15.79` is in CIDR network `172.21.0.1/32` 2024-09-13T05:41:58.382 INFO:teuthology.orchestra.run.smithi079.stdout:Mon IP `172.21.15.79` is in CIDR network `172.21.0.1/32` 2024-09-13T05:41:58.382 INFO:teuthology.orchestra.run.smithi079.stdout:Mon IP `172.21.15.79` is in CIDR network `172.21.0.2/32` 2024-09-13T05:41:58.382 INFO:teuthology.orchestra.run.smithi079.stdout:Mon IP `172.21.15.79` is in CIDR network `172.21.0.2/32` 2024-09-13T05:41:58.382 INFO:teuthology.orchestra.run.smithi079.stdout:Mon IP `172.21.15.79` is in CIDR network `172.21.15.254/32` 2024-09-13T05:41:58.382 INFO:teuthology.orchestra.run.smithi079.stdout:Mon IP `172.21.15.79` is in CIDR network `172.21.15.254/32` 2024-09-13T05:41:58.383 INFO:teuthology.orchestra.run.smithi079.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20', '172.21.0.1/32', '172.21.0.1/32', '172.21.0.2/32', '172.21.0.2/32', '172.21.15.254/32', '172.21.15.254/32'] 2024-09-13T05:41:58.383 INFO:teuthology.orchestra.run.smithi079.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T05:41:58.383 INFO:teuthology.orchestra.run.smithi079.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3... 2024-09-13T05:41:58.635 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/docker: stdout 9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3: Pulling from ceph-ci/ceph 2024-09-13T05:41:58.635 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/docker: stdout Digest: sha256:931e75f8a8ba7bd669ee47053a4500e7d74632603919af8ba169df149fde6cff 2024-09-13T05:41:58.635 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 2024-09-13T05:41:58.636 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 2024-09-13T05:42:00.173 INFO:teuthology.orchestra.run.smithi079.stdout:ceph: stdout ceph version 19.3.0-4911-g9d608eb1 (9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3) squid (dev) 2024-09-13T05:42:00.173 INFO:teuthology.orchestra.run.smithi079.stdout:Ceph version: ceph version 19.3.0-4911-g9d608eb1 (9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3) squid (dev) 2024-09-13T05:42:00.173 INFO:teuthology.orchestra.run.smithi079.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T05:42:01.553 INFO:teuthology.orchestra.run.smithi079.stdout:stat: stdout 167 167 2024-09-13T05:42:01.553 INFO:teuthology.orchestra.run.smithi079.stdout:Creating initial keys... 2024-09-13T05:42:02.902 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-authtool: stdout AQCq0ONmZkcUGRAAHjnjUYP8CaUT9Hh6/e3D2A== 2024-09-13T05:42:04.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-authtool: stdout AQCr0ONmLNwNMxAAuPUW9iEjVm05LouOKzDPug== 2024-09-13T05:42:05.755 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-authtool: stdout AQCt0ONm3+oKDxAACQ+N+yqwDEnIWw+Pq+y3gw== 2024-09-13T05:42:05.756 INFO:teuthology.orchestra.run.smithi079.stdout:Creating initial monmap... 2024-09-13T05:42:07.229 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T05:42:07.229 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-13T05:42:07.229 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:07.230 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T05:42:07.230 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool for a [v2:172.21.15.79:3300,v1:172.21.15.79:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T05:42:07.230 INFO:teuthology.orchestra.run.smithi079.stdout:setting min_mon_release = quincy 2024-09-13T05:42:07.230 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: set fsid to bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:07.230 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T05:42:07.230 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-13T05:42:07.230 INFO:teuthology.orchestra.run.smithi079.stdout:Creating mon... 2024-09-13T05:42:08.689 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.132+0000 7f3b09e10c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-13T05:42:08.689 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.132+0000 7f3b09e10c80 1 imported monmap: 2024-09-13T05:42:08.689 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-09-13T05:42:08.689 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:08.689 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-09-13T05:42:06.711537+0000 2024-09-13T05:42:08.689 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:42:08.689 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr min_mon_release 17 (quincy) 2024-09-13T05:42:08.689 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-09-13T05:42:08.689 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:42:08.689 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.690 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.132+0000 7f3b09e10c80 0 /usr/bin/ceph-mon: set fsid to bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:08.690 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: RocksDB version: 7.9.2 2024-09-13T05:42:08.690 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.690 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Git sha 0 2024-09-13T05:42:08.690 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Compile date 2024-09-12 17:11:01 2024-09-13T05:42:08.690 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: DB SUMMARY 2024-09-13T05:42:08.690 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.690 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: DB Session ID: KQ0GTQBI0B39I07V8N5Z 2024-09-13T05:42:08.690 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.690 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-09-13T05:42:08.690 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.690 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-09-13T05:42:08.690 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.error_if_exists: 0 2024-09-13T05:42:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.create_if_missing: 1 2024-09-13T05:42:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.paranoid_checks: 1 2024-09-13T05:42:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T05:42:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T05:42:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T05:42:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.env: 0x5565531c5120 2024-09-13T05:42:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-13T05:42:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.info_log: 0x5565545e2bc0 2024-09-13T05:42:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-13T05:42:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.statistics: (nil) 2024-09-13T05:42:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.use_fsync: 0 2024-09-13T05:42:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_log_file_size: 0 2024-09-13T05:42:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T05:42:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T05:42:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-13T05:42:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-13T05:42:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.allow_fallocate: 1 2024-09-13T05:42:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-13T05:42:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-13T05:42:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.use_direct_reads: 0 2024-09-13T05:42:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T05:42:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-13T05:42:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.db_log_dir: 2024-09-13T05:42:08.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.wal_dir: 2024-09-13T05:42:08.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T05:42:08.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T05:42:08.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T05:42:08.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T05:42:08.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T05:42:08.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T05:42:08.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-13T05:42:08.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-13T05:42:08.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.write_buffer_manager: 0x5565545dbcc0 2024-09-13T05:42:08.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T05:42:08.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T05:42:08.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T05:42:08.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-13T05:42:08.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T05:42:08.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-13T05:42:08.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-13T05:42:08.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-13T05:42:08.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.unordered_write: 0 2024-09-13T05:42:08.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T05:42:08.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T05:42:08.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T05:42:08.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T05:42:08.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.row_cache: None 2024-09-13T05:42:08.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.wal_filter: None 2024-09-13T05:42:08.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T05:42:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-13T05:42:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.two_write_queues: 0 2024-09-13T05:42:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-13T05:42:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.wal_compression: 0 2024-09-13T05:42:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.atomic_flush: 0 2024-09-13T05:42:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T05:42:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T05:42:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T05:42:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.log_readahead_size: 0 2024-09-13T05:42:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T05:42:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-13T05:42:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T05:42:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T05:42:08.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-13T05:42:08.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-13T05:42:08.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T05:42:08.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_background_jobs: 2 2024-09-13T05:42:08.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_background_compactions: -1 2024-09-13T05:42:08.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_subcompactions: 1 2024-09-13T05:42:08.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T05:42:08.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T05:42:08.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T05:42:08.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-13T05:42:08.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T05:42:08.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T05:42:08.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T05:42:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T05:42:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_open_files: -1 2024-09-13T05:42:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-13T05:42:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T05:42:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T05:42:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-13T05:42:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_background_flushes: -1 2024-09-13T05:42:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Compression algorithms supported: 2024-09-13T05:42:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: kZSTD supported: 0 2024-09-13T05:42:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: kXpressCompression supported: 0 2024-09-13T05:42:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: kBZip2Compression supported: 0 2024-09-13T05:42:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T05:42:08.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: kLZ4Compression supported: 1 2024-09-13T05:42:08.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: kZlibCompression supported: 1 2024-09-13T05:42:08.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-13T05:42:08.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: kSnappyCompression supported: 1 2024-09-13T05:42:08.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T05:42:08.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T05:42:08.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-09-13T05:42:08.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-09-13T05:42:08.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T05:42:08.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T05:42:08.699 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.merge_operator: 2024-09-13T05:42:08.699 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compaction_filter: None 2024-09-13T05:42:08.699 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-13T05:42:08.699 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-13T05:42:08.699 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T05:42:08.699 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T05:42:08.699 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5565545e2820) 2024-09-13T05:42:08.699 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-09-13T05:42:08.699 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T05:42:08.699 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T05:42:08.699 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-09-13T05:42:08.699 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-09-13T05:42:08.700 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-09-13T05:42:08.700 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-09-13T05:42:08.700 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-09-13T05:42:08.700 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-09-13T05:42:08.700 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-09-13T05:42:08.700 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x5565545cb610 2024-09-13T05:42:08.700 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-09-13T05:42:08.700 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-09-13T05:42:08.700 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-09-13T05:42:08.700 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-09-13T05:42:08.700 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-09-13T05:42:08.700 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-09-13T05:42:08.700 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-09-13T05:42:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-09-13T05:42:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-09-13T05:42:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-09-13T05:42:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-09-13T05:42:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-09-13T05:42:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-09-13T05:42:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-09-13T05:42:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-09-13T05:42:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-09-13T05:42:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-09-13T05:42:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-09-13T05:42:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-09-13T05:42:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-09-13T05:42:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-09-13T05:42:08.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-09-13T05:42:08.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-09-13T05:42:08.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-09-13T05:42:08.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-09-13T05:42:08.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-09-13T05:42:08.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-13T05:42:08.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-13T05:42:08.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compression: NoCompression 2024-09-13T05:42:08.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-13T05:42:08.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-13T05:42:08.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T05:42:08.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.num_levels: 7 2024-09-13T05:42:08.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T05:42:08.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T05:42:08.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T05:42:08.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T05:42:08.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T05:42:08.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T05:42:08.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T05:42:08.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T05:42:08.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T05:42:08.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T05:42:08.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T05:42:08.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T05:42:08.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T05:42:08.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-13T05:42:08.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-13T05:42:08.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T05:42:08.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T05:42:08.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T05:42:08.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T05:42:08.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-13T05:42:08.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T05:42:08.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T05:42:08.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T05:42:08.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T05:42:08.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-13T05:42:08.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T05:42:08.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T05:42:08.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T05:42:08.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T05:42:08.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T05:42:08.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T05:42:08.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T05:42:08.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T05:42:08.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T05:42:08.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T05:42:08.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T05:42:08.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T05:42:08.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T05:42:08.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T05:42:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-13T05:42:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T05:42:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T05:42:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-13T05:42:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T05:42:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T05:42:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T05:42:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T05:42:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T05:42:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T05:42:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T05:42:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T05:42:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T05:42:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T05:42:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T05:42:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-13T05:42:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T05:42:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T05:42:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T05:42:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T05:42:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.bloom_locality: 0 2024-09-13T05:42:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-13T05:42:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T05:42:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-13T05:42:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-13T05:42:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-13T05:42:08.708 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.ttl: 2592000 2024-09-13T05:42:08.708 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T05:42:08.708 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T05:42:08.708 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T05:42:08.708 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.enable_blob_files: false 2024-09-13T05:42:08.708 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.min_blob_size: 0 2024-09-13T05:42:08.708 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-13T05:42:08.708 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T05:42:08.708 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T05:42:08.708 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T05:42:08.708 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T05:42:08.708 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T05:42:08.708 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-13T05:42:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T05:42:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T05:42:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-13T05:42:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2b14cb0a-be85-41f9-8fb9-4c49ac77fcde 2024-09-13T05:42:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.136+0000 7f3b09e10c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-09-13T05:42:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.140+0000 7f3b09e10c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5565545fae00 2024-09-13T05:42:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.140+0000 7f3b09e10c80 4 rocksdb: DB pointer 0x5565546dc000 2024-09-13T05:42:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.140+0000 7f3b0159b640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T05:42:08.710 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.140+0000 7f3b0159b640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T05:42:08.710 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-09-13T05:42:08.710 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T05:42:08.710 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T05:42:08.710 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T05:42:08.710 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T05:42:08.710 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T05:42:08.710 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T05:42:08.710 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T05:42:08.710 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.710 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-13T05:42:08.710 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T05:42:08.710 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T05:42:08.711 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T05:42:08.711 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T05:42:08.711 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.711 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-13T05:42:08.711 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T05:42:08.711 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T05:42:08.711 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.711 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T05:42:08.711 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.711 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T05:42:08.711 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T05:42:08.711 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T05:42:08.711 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-09-13T05:42:08.711 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T05:42:08.712 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-09-13T05:42:08.712 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T05:42:08.712 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T05:42:08.712 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T05:42:08.712 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x5565545cb610#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.6e-05 secs_since: 0 2024-09-13T05:42:08.712 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-09-13T05:42:08.712 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.712 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-09-13T05:42:08.712 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T05:42:08.712 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.140+0000 7f3b09e10c80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-09-13T05:42:08.712 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.140+0000 7f3b09e10c80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-09-13T05:42:08.712 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T05:42:08.140+0000 7f3b09e10c80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-09-13T05:42:08.712 INFO:teuthology.orchestra.run.smithi079.stdout:create mon.a on 2024-09-13T05:42:08.919 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-09-13T05:42:09.120 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-09-13T05:42:09.360 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-bf551932-7192-11ef-bceb-c7b262605968.target -> /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968.target. 2024-09-13T05:42:09.360 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-bf551932-7192-11ef-bceb-c7b262605968.target -> /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968.target. 2024-09-13T05:42:09.642 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bf551932-7192-11ef-bceb-c7b262605968@mon.a 2024-09-13T05:42:09.642 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bf551932-7192-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-bf551932-7192-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-13T05:42:09.848 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968.target.wants/ceph-bf551932-7192-11ef-bceb-c7b262605968@mon.a.service -> /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968@.service. 2024-09-13T05:42:09.858 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld does not appear to be present 2024-09-13T05:42:09.858 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T05:42:09.858 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mon to start... 2024-09-13T05:42:09.858 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mon... 2024-09-13T05:42:11.735 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:11 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.458493+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T05:42:12.281 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T05:42:12.282 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout id: bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:12.282 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T05:42:12.282 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-13T05:42:12.282 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout services: 2024-09-13T05:42:12.282 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.289038s) 2024-09-13T05:42:12.284 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T05:42:12.284 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T05:42:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-13T05:42:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout data: 2024-09-13T05:42:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T05:42:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T05:42:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T05:42:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T05:42:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-13T05:42:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.408+0000 7fcfef8ce640 1 Processor -- start 2024-09-13T05:42:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.408+0000 7fcfef8ce640 1 -- start start 2024-09-13T05:42:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.408+0000 7fcfef8ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 0x7fcfe8109520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.408+0000 7fcfef8ce640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe8109a60 con 0x7fcfe807a440 2024-09-13T05:42:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.408+0000 7fcfed66a640 1 -- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 msgr2=0x7fcfe8109520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.79:3300/0 2024-09-13T05:42:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.408+0000 7fcfed66a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 0x7fcfe8109520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T05:42:12.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.612+0000 7fcfed66a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 0x7fcfe8109520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:12.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.612+0000 7fcfed66a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 0x7fcfe8109520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46872/0 (socket says 172.21.15.79:46872) 2024-09-13T05:42:12.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.612+0000 7fcfed66a640 1 -- 172.21.15.79:0/2940260625 learned_addr learned my addr 172.21.15.79:0/2940260625 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:12.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.612+0000 7fcfed66a640 1 -- 172.21.15.79:0/2940260625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe8109be0 con 0x7fcfe807a440 2024-09-13T05:42:12.290 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.612+0000 7fcfed66a640 1 --2- 172.21.15.79:0/2940260625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 0x7fcfe8109520 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009e50 tx=0x7fcfe402a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ec825ceb15a615 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:12.290 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.612+0000 7fcfdffff640 1 -- 172.21.15.79:0/2940260625 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe4003ae0 con 0x7fcfe807a440 2024-09-13T05:42:12.290 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.612+0000 7fcfdffff640 1 -- 172.21.15.79:0/2940260625 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe4003c80 con 0x7fcfe807a440 2024-09-13T05:42:12.290 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.612+0000 7fcfdffff640 1 -- 172.21.15.79:0/2940260625 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe4005070 con 0x7fcfe807a440 2024-09-13T05:42:12.290 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfef8ce640 1 -- 172.21.15.79:0/2940260625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 msgr2=0x7fcfe8109520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:12.290 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfef8ce640 1 --2- 172.21.15.79:0/2940260625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 0x7fcfe8109520 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009e50 tx=0x7fcfe402a7f0 comp rx=0 tx=0).stop 2024-09-13T05:42:12.291 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfef8ce640 1 -- 172.21.15.79:0/2940260625 shutdown_connections 2024-09-13T05:42:12.291 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfef8ce640 1 --2- 172.21.15.79:0/2940260625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 0x7fcfe8109520 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:12.292 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfef8ce640 1 -- 172.21.15.79:0/2940260625 >> 172.21.15.79:0/2940260625 conn(0x7fcfe81011b0 msgr2=0x7fcfe81035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:12.292 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfef8ce640 1 -- 172.21.15.79:0/2940260625 shutdown_connections 2024-09-13T05:42:12.292 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfef8ce640 1 -- 172.21.15.79:0/2940260625 wait complete. 2024-09-13T05:42:12.292 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfef8ce640 1 Processor -- start 2024-09-13T05:42:12.292 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfef8ce640 1 -- start start 2024-09-13T05:42:12.292 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfef8ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 0x7fcfe819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:12.292 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfef8ce640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe810a160 con 0x7fcfe807a440 2024-09-13T05:42:12.292 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfed66a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 0x7fcfe819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:12.292 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfed66a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 0x7fcfe819a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46882/0 (socket says 172.21.15.79:46882) 2024-09-13T05:42:12.292 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfed66a640 1 -- 172.21.15.79:0/2416682933 learned_addr learned my addr 172.21.15.79:0/2416682933 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:12.292 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfed66a640 1 -- 172.21.15.79:0/2416682933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe819a670 con 0x7fcfe807a440 2024-09-13T05:42:12.292 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfed66a640 1 --2- 172.21.15.79:0/2416682933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 0x7fcfe819a110 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009e50 tx=0x7fcfe4005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:12.292 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfde7fc640 1 -- 172.21.15.79:0/2416682933 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe4041020 con 0x7fcfe807a440 2024-09-13T05:42:12.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfde7fc640 1 -- 172.21.15.79:0/2416682933 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe40057f0 con 0x7fcfe807a440 2024-09-13T05:42:12.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfde7fc640 1 -- 172.21.15.79:0/2416682933 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe4032580 con 0x7fcfe807a440 2024-09-13T05:42:12.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfef8ce640 1 -- 172.21.15.79:0/2416682933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe819a900 con 0x7fcfe807a440 2024-09-13T05:42:12.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfef8ce640 1 -- 172.21.15.79:0/2416682933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe819b2c0 con 0x7fcfe807a440 2024-09-13T05:42:12.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfde7fc640 1 -- 172.21.15.79:0/2416682933 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcfe4044020 con 0x7fcfe807a440 2024-09-13T05:42:12.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.616+0000 7fcfde7fc640 1 -- 172.21.15.79:0/2416682933 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcfe4037030 con 0x7fcfe807a440 2024-09-13T05:42:12.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.620+0000 7fcfef8ce640 1 -- 172.21.15.79:0/2416682933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe8107590 con 0x7fcfe807a440 2024-09-13T05:42:12.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.620+0000 7fcfde7fc640 1 -- 172.21.15.79:0/2416682933 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fcfe404b030 con 0x7fcfe807a440 2024-09-13T05:42:12.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.744+0000 7fcfef8ce640 1 -- 172.21.15.79:0/2416682933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fcfe819b8c0 con 0x7fcfe807a440 2024-09-13T05:42:12.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.744+0000 7fcfde7fc640 1 -- 172.21.15.79:0/2416682933 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fcfe4046400 con 0x7fcfe807a440 2024-09-13T05:42:12.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.748+0000 7fcfef8ce640 1 -- 172.21.15.79:0/2416682933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 msgr2=0x7fcfe819a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:12.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.748+0000 7fcfef8ce640 1 --2- 172.21.15.79:0/2416682933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 0x7fcfe819a110 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009e50 tx=0x7fcfe4005a50 comp rx=0 tx=0).stop 2024-09-13T05:42:12.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.748+0000 7fcfef8ce640 1 -- 172.21.15.79:0/2416682933 shutdown_connections 2024-09-13T05:42:12.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.748+0000 7fcfef8ce640 1 --2- 172.21.15.79:0/2416682933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfe807a440 0x7fcfe819a110 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:12.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.748+0000 7fcfef8ce640 1 -- 172.21.15.79:0/2416682933 >> 172.21.15.79:0/2416682933 conn(0x7fcfe81011b0 msgr2=0x7fcfe8101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:12.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.748+0000 7fcfef8ce640 1 -- 172.21.15.79:0/2416682933 shutdown_connections 2024-09-13T05:42:12.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:11.748+0000 7fcfef8ce640 1 -- 172.21.15.79:0/2416682933 wait complete. 2024-09-13T05:42:12.295 INFO:teuthology.orchestra.run.smithi079.stdout:mon is available 2024-09-13T05:42:12.295 INFO:teuthology.orchestra.run.smithi079.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T05:42:12.735 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461323+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T05:42:12.736 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461323+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T05:42:12.736 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461473+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 1 2024-09-13T05:42:12.736 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461473+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 1 2024-09-13T05:42:12.736 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461483+0000 mon.a (mon.0) 4 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:12.736 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461483+0000 mon.a (mon.0) 4 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:12.736 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461490+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-13T05:42:06.711537+0000 2024-09-13T05:42:12.736 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461490+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-13T05:42:06.711537+0000 2024-09-13T05:42:12.736 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461498+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:42:12.736 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461498+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:42:12.736 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461506+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:42:12.736 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461506+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:42:12.736 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461514+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-13T05:42:12.736 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461514+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-13T05:42:12.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461521+0000 mon.a (mon.0) 9 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:42:12.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.461521+0000 mon.a (mon.0) 9 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:42:12.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.463416+0000 mon.a (mon.0) 10 : cluster [DBG] fsmap 2024-09-13T05:42:12.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.463416+0000 mon.a (mon.0) 10 : cluster [DBG] fsmap 2024-09-13T05:42:12.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.465385+0000 mon.a (mon.0) 11 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-13T05:42:12.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.465385+0000 mon.a (mon.0) 11 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-13T05:42:12.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.465802+0000 mon.a (mon.0) 12 : cluster [DBG] mgrmap e1: no daemons active 2024-09-13T05:42:12.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: cluster 2024-09-13T05:42:11.465802+0000 mon.a (mon.0) 12 : cluster [DBG] mgrmap e1: no daemons active 2024-09-13T05:42:12.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: audit 2024-09-13T05:42:11.750304+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.79:0/2416682933' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-13T05:42:12.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:12 smithi079 bash[22332]: audit 2024-09-13T05:42:11.750304+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.79:0/2416682933' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-13T05:42:13.985 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:13 smithi079 bash[22332]: audit 2024-09-13T05:42:13.494889+0000 mon.a (mon.0) 14 : audit [INF] from='client.? 172.21.15.79:0/3537089125' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-13T05:42:13.988 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:13 smithi079 bash[22332]: audit 2024-09-13T05:42:13.494889+0000 mon.a (mon.0) 14 : audit [INF] from='client.? 172.21.15.79:0/3537089125' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-13T05:42:13.988 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:13 smithi079 bash[22332]: audit 2024-09-13T05:42:13.498894+0000 mon.a (mon.0) 15 : audit [INF] from='client.? 172.21.15.79:0/3537089125' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T05:42:13.988 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:13 smithi079 bash[22332]: audit 2024-09-13T05:42:13.498894+0000 mon.a (mon.0) 15 : audit [INF] from='client.? 172.21.15.79:0/3537089125' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T05:42:14.078 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-13T05:42:14.078 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T05:42:14.078 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout fsid = bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:14.078 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-13T05:42:14.078 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.79:3300,v1:172.21.15.79:6789] 2024-09-13T05:42:14.078 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T05:42:14.078 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T05:42:14.078 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T05:42:14.078 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T05:42:14.079 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-13T05:42:14.079 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T05:42:14.079 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T05:42:14.079 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-13T05:42:14.079 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T05:42:14.079 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T05:42:14.079 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T05:42:14.079 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.360+0000 7f154151c640 1 Processor -- start 2024-09-13T05:42:14.079 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.360+0000 7f154151c640 1 -- start start 2024-09-13T05:42:14.079 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.360+0000 7f154151c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f153c108b40 0x7f153c108f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:14.079 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.360+0000 7f154151c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f153c109530 con 0x7f153c108b40 2024-09-13T05:42:14.079 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.360+0000 7f153affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f153c108b40 0x7f153c108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:14.079 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f153affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f153c108b40 0x7f153c108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39388/0 (socket says 172.21.15.79:39388) 2024-09-13T05:42:14.080 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f153affd640 1 -- 172.21.15.79:0/4239281230 learned_addr learned my addr 172.21.15.79:0/4239281230 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:14.080 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f153affd640 1 -- 172.21.15.79:0/4239281230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f153c1096b0 con 0x7f153c108b40 2024-09-13T05:42:14.080 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f153affd640 1 --2- 172.21.15.79:0/4239281230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f153c108b40 0x7f153c108f40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1524009820 tx=0x7f152402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8489e37edf72e68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:14.080 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f1539ffb640 1 -- 172.21.15.79:0/4239281230 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1524037070 con 0x7f153c108b40 2024-09-13T05:42:14.080 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f1539ffb640 1 -- 172.21.15.79:0/4239281230 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1524032440 con 0x7f153c108b40 2024-09-13T05:42:14.080 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f1539ffb640 1 -- 172.21.15.79:0/4239281230 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1524032740 con 0x7f153c108b40 2024-09-13T05:42:14.080 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f154151c640 1 -- 172.21.15.79:0/4239281230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f153c108b40 msgr2=0x7f153c108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:14.080 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f154151c640 1 --2- 172.21.15.79:0/4239281230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f153c108b40 0x7f153c108f40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1524009820 tx=0x7f152402a270 comp rx=0 tx=0).stop 2024-09-13T05:42:14.080 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f154151c640 1 -- 172.21.15.79:0/4239281230 shutdown_connections 2024-09-13T05:42:14.080 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f154151c640 1 --2- 172.21.15.79:0/4239281230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f153c108b40 0x7f153c108f40 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:14.080 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f154151c640 1 -- 172.21.15.79:0/4239281230 >> 172.21.15.79:0/4239281230 conn(0x7f153c07c200 msgr2=0x7f153c07c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:14.080 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f154151c640 1 -- 172.21.15.79:0/4239281230 shutdown_connections 2024-09-13T05:42:14.081 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f154151c640 1 -- 172.21.15.79:0/4239281230 wait complete. 2024-09-13T05:42:14.081 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f154151c640 1 Processor -- start 2024-09-13T05:42:14.081 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f154151c640 1 -- start start 2024-09-13T05:42:14.081 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f154151c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f153c108b40 0x7f153c19c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:14.081 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f154151c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f153c10a050 con 0x7f153c108b40 2024-09-13T05:42:14.081 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f153affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f153c108b40 0x7f153c19c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:14.081 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f153affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f153c108b40 0x7f153c19c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39400/0 (socket says 172.21.15.79:39400) 2024-09-13T05:42:14.081 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f153affd640 1 -- 172.21.15.79:0/3537089125 learned_addr learned my addr 172.21.15.79:0/3537089125 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:14.081 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f153affd640 1 -- 172.21.15.79:0/3537089125 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f153c19c8b0 con 0x7f153c108b40 2024-09-13T05:42:14.081 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f153affd640 1 --2- 172.21.15.79:0/3537089125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f153c108b40 0x7f153c19c350 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f15240090b0 tx=0x7f15240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:14.081 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f1533fff640 1 -- 172.21.15.79:0/3537089125 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1524041070 con 0x7f153c108b40 2024-09-13T05:42:14.081 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f1533fff640 1 -- 172.21.15.79:0/3537089125 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f152403c7a0 con 0x7f153c108b40 2024-09-13T05:42:14.081 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.364+0000 7f1533fff640 1 -- 172.21.15.79:0/3537089125 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1524037040 con 0x7f153c108b40 2024-09-13T05:42:14.082 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.368+0000 7f154151c640 1 -- 172.21.15.79:0/3537089125 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f153c19cb40 con 0x7f153c108b40 2024-09-13T05:42:14.082 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.368+0000 7f154151c640 1 -- 172.21.15.79:0/3537089125 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f153c19d500 con 0x7f153c108b40 2024-09-13T05:42:14.082 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.368+0000 7f1533fff640 1 -- 172.21.15.79:0/3537089125 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1524044070 con 0x7f153c108b40 2024-09-13T05:42:14.082 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.368+0000 7f1533fff640 1 -- 172.21.15.79:0/3537089125 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f152403d3f0 con 0x7f153c108b40 2024-09-13T05:42:14.082 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.368+0000 7f154151c640 1 -- 172.21.15.79:0/3537089125 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f153c10a800 con 0x7f153c108b40 2024-09-13T05:42:14.082 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.368+0000 7f1533fff640 1 -- 172.21.15.79:0/3537089125 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f152403cdc0 con 0x7f153c108b40 2024-09-13T05:42:14.082 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.488+0000 7f154151c640 1 -- 172.21.15.79:0/3537089125 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f153c19e2a0 con 0x7f153c108b40 2024-09-13T05:42:14.082 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.496+0000 7f1533fff640 1 -- 172.21.15.79:0/3537089125 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+374 (secure 0 0 0) 0x7f1524046450 con 0x7f153c108b40 2024-09-13T05:42:14.082 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.496+0000 7f1533fff640 1 -- 172.21.15.79:0/3537089125 <== mon.0 v2:172.21.15.79:3300/0 8 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f1524054020 con 0x7f153c108b40 2024-09-13T05:42:14.082 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.496+0000 7f154151c640 1 -- 172.21.15.79:0/3537089125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f153c108b40 msgr2=0x7f153c19c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:14.082 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.496+0000 7f154151c640 1 --2- 172.21.15.79:0/3537089125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f153c108b40 0x7f153c19c350 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f15240090b0 tx=0x7f15240046c0 comp rx=0 tx=0).stop 2024-09-13T05:42:14.082 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.496+0000 7f154151c640 1 -- 172.21.15.79:0/3537089125 shutdown_connections 2024-09-13T05:42:14.082 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.496+0000 7f154151c640 1 --2- 172.21.15.79:0/3537089125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f153c108b40 0x7f153c19c350 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:14.082 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.496+0000 7f154151c640 1 -- 172.21.15.79:0/3537089125 >> 172.21.15.79:0/3537089125 conn(0x7f153c07c200 msgr2=0x7f153c192e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:14.083 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.496+0000 7f154151c640 1 -- 172.21.15.79:0/3537089125 shutdown_connections 2024-09-13T05:42:14.083 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:13.496+0000 7f154151c640 1 -- 172.21.15.79:0/3537089125 wait complete. 2024-09-13T05:42:14.083 INFO:teuthology.orchestra.run.smithi079.stdout:Generating new minimal ceph.conf... 2024-09-13T05:42:15.485 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:15 smithi079 bash[22332]: audit 2024-09-13T05:42:15.206516+0000 mon.a (mon.0) 16 : audit [DBG] from='client.? 172.21.15.79:0/3976906154' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:42:15.485 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:15 smithi079 bash[22332]: audit 2024-09-13T05:42:15.206516+0000 mon.a (mon.0) 16 : audit [DBG] from='client.? 172.21.15.79:0/3976906154' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:42:15.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.076+0000 7f7670ffa640 1 Processor -- start 2024-09-13T05:42:15.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f7670ffa640 1 -- start start 2024-09-13T05:42:15.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f7670ffa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766c106960 0x7f766c106d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:15.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f7670ffa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f766c107350 con 0x7f766c106960 2024-09-13T05:42:15.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f766a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766c106960 0x7f766c106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:15.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f766a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766c106960 0x7f766c106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39406/0 (socket says 172.21.15.79:39406) 2024-09-13T05:42:15.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f766a59c640 1 -- 172.21.15.79:0/1563591991 learned_addr learned my addr 172.21.15.79:0/1563591991 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:15.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f766a59c640 1 -- 172.21.15.79:0/1563591991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766c1074d0 con 0x7f766c106960 2024-09-13T05:42:15.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f766a59c640 1 --2- 172.21.15.79:0/1563591991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766c106960 0x7f766c106d60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f765c009820 tx=0x7f765c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92be5465d061499 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:15.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f766959a640 1 -- 172.21.15.79:0/1563591991 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f765c037070 con 0x7f766c106960 2024-09-13T05:42:15.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f766959a640 1 -- 172.21.15.79:0/1563591991 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f765c0328a0 con 0x7f766c106960 2024-09-13T05:42:15.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f766959a640 1 -- 172.21.15.79:0/1563591991 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f765c030690 con 0x7f766c106960 2024-09-13T05:42:15.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f7670ffa640 1 -- 172.21.15.79:0/1563591991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766c106960 msgr2=0x7f766c106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:15.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f7670ffa640 1 --2- 172.21.15.79:0/1563591991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766c106960 0x7f766c106d60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f765c009820 tx=0x7f765c02a270 comp rx=0 tx=0).stop 2024-09-13T05:42:15.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f7670ffa640 1 -- 172.21.15.79:0/1563591991 shutdown_connections 2024-09-13T05:42:15.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f7670ffa640 1 --2- 172.21.15.79:0/1563591991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766c106960 0x7f766c106d60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:15.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f7670ffa640 1 -- 172.21.15.79:0/1563591991 >> 172.21.15.79:0/1563591991 conn(0x7f766c102250 msgr2=0x7f766c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:15.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f7670ffa640 1 -- 172.21.15.79:0/1563591991 shutdown_connections 2024-09-13T05:42:15.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f7670ffa640 1 -- 172.21.15.79:0/1563591991 wait complete. 2024-09-13T05:42:15.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f7670ffa640 1 Processor -- start 2024-09-13T05:42:15.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f7670ffa640 1 -- start start 2024-09-13T05:42:15.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f7670ffa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766c106960 0x7f766c19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:15.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f7670ffa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f766c10ade0 con 0x7f766c106960 2024-09-13T05:42:15.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f766a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766c106960 0x7f766c19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:15.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f766a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766c106960 0x7f766c19a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39422/0 (socket says 172.21.15.79:39422) 2024-09-13T05:42:15.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.080+0000 7f766a59c640 1 -- 172.21.15.79:0/3976906154 learned_addr learned my addr 172.21.15.79:0/3976906154 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:15.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.084+0000 7f766a59c640 1 -- 172.21.15.79:0/3976906154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766c19ae40 con 0x7f766c106960 2024-09-13T05:42:15.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.084+0000 7f766a59c640 1 --2- 172.21.15.79:0/3976906154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766c106960 0x7f766c19a8e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f765c000c00 tx=0x7f765c032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:15.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.084+0000 7f765b7fe640 1 -- 172.21.15.79:0/3976906154 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f765c037040 con 0x7f766c106960 2024-09-13T05:42:15.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.084+0000 7f765b7fe640 1 -- 172.21.15.79:0/3976906154 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f765c040070 con 0x7f766c106960 2024-09-13T05:42:15.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.084+0000 7f7670ffa640 1 -- 172.21.15.79:0/3976906154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766c19b0d0 con 0x7f766c106960 2024-09-13T05:42:15.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.084+0000 7f765b7fe640 1 -- 172.21.15.79:0/3976906154 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f765c03be40 con 0x7f766c106960 2024-09-13T05:42:15.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.084+0000 7f7670ffa640 1 -- 172.21.15.79:0/3976906154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f766c19ba90 con 0x7f766c106960 2024-09-13T05:42:15.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.084+0000 7f765b7fe640 1 -- 172.21.15.79:0/3976906154 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f765c045460 con 0x7f766c106960 2024-09-13T05:42:15.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.084+0000 7f765b7fe640 1 -- 172.21.15.79:0/3976906154 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f765c044780 con 0x7f766c106960 2024-09-13T05:42:15.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.084+0000 7f7670ffa640 1 -- 172.21.15.79:0/3976906154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f766c106de0 con 0x7f766c106960 2024-09-13T05:42:15.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.084+0000 7f765b7fe640 1 -- 172.21.15.79:0/3976906154 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f765c03b430 con 0x7f766c106960 2024-09-13T05:42:15.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.200+0000 7f7670ffa640 1 -- 172.21.15.79:0/3976906154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f766c19bcf0 con 0x7f766c106960 2024-09-13T05:42:15.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.200+0000 7f765b7fe640 1 -- 172.21.15.79:0/3976906154 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f765c03b680 con 0x7f766c106960 2024-09-13T05:42:15.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.204+0000 7f7670ffa640 1 -- 172.21.15.79:0/3976906154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766c106960 msgr2=0x7f766c19a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:15.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.204+0000 7f7670ffa640 1 --2- 172.21.15.79:0/3976906154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766c106960 0x7f766c19a8e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f765c000c00 tx=0x7f765c032740 comp rx=0 tx=0).stop 2024-09-13T05:42:15.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.204+0000 7f7670ffa640 1 -- 172.21.15.79:0/3976906154 shutdown_connections 2024-09-13T05:42:15.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.204+0000 7f7670ffa640 1 --2- 172.21.15.79:0/3976906154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766c106960 0x7f766c19a8e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:15.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.204+0000 7f7670ffa640 1 -- 172.21.15.79:0/3976906154 >> 172.21.15.79:0/3976906154 conn(0x7f766c102250 msgr2=0x7f766c102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:15.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.204+0000 7f7670ffa640 1 -- 172.21.15.79:0/3976906154 shutdown_connections 2024-09-13T05:42:15.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:15.204+0000 7f7670ffa640 1 -- 172.21.15.79:0/3976906154 wait complete. 2024-09-13T05:42:15.779 INFO:teuthology.orchestra.run.smithi079.stdout:Restarting the monitor... 2024-09-13T05:42:16.103 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:15 smithi079 systemd[1]: Stopping Ceph mon.a for bf551932-7192-11ef-bceb-c7b262605968... 2024-09-13T05:42:16.103 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:15 smithi079 bash[22332]: debug 2024-09-13T05:42:15.892+0000 7ff7c3dcd640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-13T05:42:16.103 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:15 smithi079 bash[22332]: debug 2024-09-13T05:42:15.892+0000 7ff7c3dcd640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T05:42:16.563 INFO:teuthology.orchestra.run.smithi079.stdout:Setting public_network to 172.21.15.254/32,172.21.0.2/32,172.21.0.0/20,172.21.0.1/32 in mon config section 2024-09-13T05:42:16.681 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:16 smithi079 bash[22715]: ceph-bf551932-7192-11ef-bceb-c7b262605968-mon-a 2024-09-13T05:42:16.681 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:16 smithi079 bash[22776]: Error response from daemon: No such container: ceph-bf551932-7192-11ef-bceb-c7b262605968-mon-a 2024-09-13T05:42:16.681 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:16 smithi079 systemd[1]: ceph-bf551932-7192-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-13T05:42:16.681 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:16 smithi079 systemd[1]: Stopped Ceph mon.a for bf551932-7192-11ef-bceb-c7b262605968. 2024-09-13T05:42:16.681 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:16 smithi079 systemd[1]: Started Ceph mon.a for bf551932-7192-11ef-bceb-c7b262605968. 2024-09-13T05:42:18.235 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.004+0000 7f1d7d350c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-13T05:42:18.235 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.004+0000 7f1d7d350c80 0 ceph version 19.3.0-4911-g9d608eb1 (9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3) squid (dev), process ceph-mon, pid 7 2024-09-13T05:42:18.235 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.004+0000 7f1d7d350c80 0 pidfile_write: ignore empty --pid-file 2024-09-13T05:42:18.235 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 0 load: jerasure load: lrc 2024-09-13T05:42:18.235 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: RocksDB version: 7.9.2 2024-09-13T05:42:18.235 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Git sha 0 2024-09-13T05:42:18.235 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Compile date 2024-09-12 17:11:01 2024-09-13T05:42:18.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: DB SUMMARY 2024-09-13T05:42:18.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: DB Session ID: 8WL6S9K357T8HZ3WEI6I 2024-09-13T05:42:18.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: CURRENT file: CURRENT 2024-09-13T05:42:18.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-13T05:42:18.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-13T05:42:18.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T05:42:18.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 91882 ; 2024-09-13T05:42:18.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.error_if_exists: 0 2024-09-13T05:42:18.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.create_if_missing: 0 2024-09-13T05:42:18.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.paranoid_checks: 1 2024-09-13T05:42:18.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T05:42:18.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T05:42:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T05:42:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.env: 0x55d673b2c120 2024-09-13T05:42:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-13T05:42:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.info_log: 0x55d675e9f700 2024-09-13T05:42:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-13T05:42:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.statistics: (nil) 2024-09-13T05:42:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.use_fsync: 0 2024-09-13T05:42:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_log_file_size: 0 2024-09-13T05:42:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T05:42:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T05:42:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-13T05:42:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-13T05:42:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.allow_fallocate: 1 2024-09-13T05:42:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-13T05:42:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-13T05:42:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.use_direct_reads: 0 2024-09-13T05:42:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T05:42:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-13T05:42:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.db_log_dir: 2024-09-13T05:42:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.wal_dir: 2024-09-13T05:42:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T05:42:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T05:42:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T05:42:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T05:42:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T05:42:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T05:42:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-13T05:42:18.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-13T05:42:18.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.write_buffer_manager: 0x55d675ea3b80 2024-09-13T05:42:18.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T05:42:18.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T05:42:18.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T05:42:18.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-13T05:42:18.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T05:42:18.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-13T05:42:18.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-13T05:42:18.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-13T05:42:18.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.unordered_write: 0 2024-09-13T05:42:18.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T05:42:18.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T05:42:18.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T05:42:18.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T05:42:18.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.row_cache: None 2024-09-13T05:42:18.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.wal_filter: None 2024-09-13T05:42:18.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T05:42:18.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-13T05:42:18.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.two_write_queues: 0 2024-09-13T05:42:18.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-13T05:42:18.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.wal_compression: 0 2024-09-13T05:42:18.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.atomic_flush: 0 2024-09-13T05:42:18.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T05:42:18.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T05:42:18.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T05:42:18.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.log_readahead_size: 0 2024-09-13T05:42:18.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T05:42:18.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-13T05:42:18.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T05:42:18.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T05:42:18.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-13T05:42:18.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-13T05:42:18.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T05:42:18.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_background_jobs: 2 2024-09-13T05:42:18.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_background_compactions: -1 2024-09-13T05:42:18.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_subcompactions: 1 2024-09-13T05:42:18.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T05:42:18.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T05:42:18.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T05:42:18.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-13T05:42:18.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T05:42:18.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T05:42:18.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T05:42:18.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T05:42:18.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_open_files: -1 2024-09-13T05:42:18.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-13T05:42:18.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T05:42:18.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T05:42:18.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-13T05:42:18.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_background_flushes: -1 2024-09-13T05:42:18.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Compression algorithms supported: 2024-09-13T05:42:18.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: kZSTD supported: 0 2024-09-13T05:42:18.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: kXpressCompression supported: 0 2024-09-13T05:42:18.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: kBZip2Compression supported: 0 2024-09-13T05:42:18.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T05:42:18.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: kLZ4Compression supported: 1 2024-09-13T05:42:18.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: kZlibCompression supported: 1 2024-09-13T05:42:18.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-13T05:42:18.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: kSnappyCompression supported: 1 2024-09-13T05:42:18.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T05:42:18.245 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T05:42:18.245 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-13T05:42:18.245 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T05:42:18.245 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T05:42:18.245 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.merge_operator: 2024-09-13T05:42:18.245 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compaction_filter: None 2024-09-13T05:42:18.245 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-13T05:42:18.245 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-13T05:42:18.245 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T05:42:18.245 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T05:42:18.245 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d675e9f320) 2024-09-13T05:42:18.245 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cache_index_and_filter_blocks: 1 2024-09-13T05:42:18.245 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: pin_top_level_index_and_filter: 1 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: index_type: 0 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: data_block_index_type: 0 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: index_shortening: 1 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: data_block_hash_table_util_ratio: 0.750000 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: checksum: 4 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: no_block_cache: 0 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: block_cache: 0x55d675e95610 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: block_cache_name: BinnedLRUCache 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: block_cache_options: 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: capacity : 536870912 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: num_shard_bits : 4 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: strict_capacity_limit : 0 2024-09-13T05:42:18.246 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: high_pri_pool_ratio: 0.000 2024-09-13T05:42:18.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: block_cache_compressed: (nil) 2024-09-13T05:42:18.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: persistent_cache: (nil) 2024-09-13T05:42:18.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: block_size: 4096 2024-09-13T05:42:18.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: block_size_deviation: 10 2024-09-13T05:42:18.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: block_restart_interval: 16 2024-09-13T05:42:18.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: index_block_restart_interval: 1 2024-09-13T05:42:18.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: metadata_block_size: 4096 2024-09-13T05:42:18.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: partition_filters: 0 2024-09-13T05:42:18.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: use_delta_encoding: 1 2024-09-13T05:42:18.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: filter_policy: bloomfilter 2024-09-13T05:42:18.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: whole_key_filtering: 1 2024-09-13T05:42:18.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: verify_compression: 0 2024-09-13T05:42:18.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: read_amp_bytes_per_bit: 0 2024-09-13T05:42:18.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: format_version: 5 2024-09-13T05:42:18.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: enable_index_compression: 1 2024-09-13T05:42:18.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: block_align: 0 2024-09-13T05:42:18.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: max_auto_readahead_size: 262144 2024-09-13T05:42:18.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: prepopulate_block_cache: 0 2024-09-13T05:42:18.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: initial_auto_readahead_size: 8192 2024-09-13T05:42:18.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: num_file_reads_for_auto_readahead: 2 2024-09-13T05:42:18.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-13T05:42:18.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-13T05:42:18.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compression: NoCompression 2024-09-13T05:42:18.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-13T05:42:18.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-13T05:42:18.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T05:42:18.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.num_levels: 7 2024-09-13T05:42:18.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T05:42:18.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T05:42:18.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T05:42:18.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T05:42:18.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T05:42:18.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T05:42:18.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T05:42:18.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T05:42:18.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T05:42:18.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T05:42:18.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T05:42:18.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T05:42:18.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T05:42:18.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-13T05:42:18.250 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-13T05:42:18.250 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T05:42:18.250 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T05:42:18.250 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T05:42:18.250 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T05:42:18.250 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-13T05:42:18.250 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T05:42:18.250 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T05:42:18.250 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T05:42:18.250 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T05:42:18.250 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-13T05:42:18.250 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T05:42:18.250 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T05:42:18.251 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T05:42:18.252 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-13T05:42:18.252 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T05:42:18.252 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T05:42:18.252 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T05:42:18.252 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T05:42:18.252 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T05:42:18.252 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T05:42:18.252 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T05:42:18.252 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T05:42:18.252 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T05:42:18.252 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T05:42:18.252 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T05:42:18.252 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-13T05:42:18.252 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T05:42:18.253 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T05:42:18.253 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T05:42:18.253 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T05:42:18.253 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.bloom_locality: 0 2024-09-13T05:42:18.253 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-13T05:42:18.253 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T05:42:18.253 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-13T05:42:18.253 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-13T05:42:18.253 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-13T05:42:18.253 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.ttl: 2592000 2024-09-13T05:42:18.253 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T05:42:18.253 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T05:42:18.254 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T05:42:18.254 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.enable_blob_files: false 2024-09-13T05:42:18.254 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.min_blob_size: 0 2024-09-13T05:42:18.254 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-13T05:42:18.254 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T05:42:18.254 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T05:42:18.254 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T05:42:18.254 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T05:42:18.254 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T05:42:18.254 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-13T05:42:18.254 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.008+0000 7f1d7d350c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T05:42:18.254 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.012+0000 7f1d7d350c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-13T05:42:18.255 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.012+0000 7f1d7d350c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-13T05:42:18.255 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.012+0000 7f1d7d350c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2b14cb0a-be85-41f9-8fb9-4c49ac77fcde 2024-09-13T05:42:18.255 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.012+0000 7f1d7d350c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726206138015442, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-13T05:42:18.255 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.012+0000 7f1d7d350c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-13T05:42:18.255 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.012+0000 7f1d7d350c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726206138016982, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 88311, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 273, "table_properties": {"data_size": 86379, "index_size": 252, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 10932, "raw_average_key_size": 47, "raw_value_size": 80197, "raw_average_value_size": 345, "num_data_blocks": 11, "num_entries": 232, "num_filter_entries": 232, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726206138, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2b14cb0a-be85-41f9-8fb9-4c49ac77fcde", "db_session_id": "8WL6S9K357T8HZ3WEI6I", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-13T05:42:18.255 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.012+0000 7f1d7d350c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726206138017138, "job": 1, "event": "recovery_finished"} 2024-09-13T05:42:18.255 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.012+0000 7f1d7d350c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-13T05:42:18.255 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.016+0000 7f1d7d350c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T05:42:18.255 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.016+0000 7f1d7d350c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d675ec2e00 2024-09-13T05:42:18.255 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.016+0000 7f1d7d350c80 4 rocksdb: DB pointer 0x55d675fc6000 2024-09-13T05:42:18.256 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.016+0000 7f1d73118640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T05:42:18.256 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.016+0000 7f1d73118640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T05:42:18.256 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: ** DB Stats ** 2024-09-13T05:42:18.256 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T05:42:18.256 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T05:42:18.256 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T05:42:18.256 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T05:42:18.256 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T05:42:18.256 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T05:42:18.256 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T05:42:18.256 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: ** Compaction Stats [default] ** 2024-09-13T05:42:18.256 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T05:42:18.256 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T05:42:18.257 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: L0 2/0 88.10 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 89.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T05:42:18.257 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Sum 2/0 88.10 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 89.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T05:42:18.257 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 89.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T05:42:18.257 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: ** Compaction Stats [default] ** 2024-09-13T05:42:18.257 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T05:42:18.257 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T05:42:18.257 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 89.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T05:42:18.257 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T05:42:18.257 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T05:42:18.257 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T05:42:18.257 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T05:42:18.257 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T05:42:18.258 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T05:42:18.258 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: AddFile(Keys): cumulative 0, interval 0 2024-09-13T05:42:18.258 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Cumulative compaction: 0.00 GB write, 16.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T05:42:18.258 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Interval compaction: 0.00 GB write, 16.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T05:42:18.258 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T05:42:18.258 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Block cache BinnedLRUCache@0x55d675e95610#7 capacity: 512.00 MB usage: 1.27 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2024-09-13T05:42:18.258 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-09-13T05:42:18.258 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: ** File Read Latency Histogram By Level [default] ** 2024-09-13T05:42:18.258 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.016+0000 7f1d7d350c80 0 starting mon.a rank 0 at public addrs [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] at bind addrs [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:18.258 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.016+0000 7f1d7d350c80 1 mon.a@-1(???) e1 preinit fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:18.258 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.016+0000 7f1d7d350c80 0 mon.a@-1(???).mds e1 new map 2024-09-13T05:42:18.258 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.016+0000 7f1d7d350c80 0 mon.a@-1(???).mds e1 print_map 2024-09-13T05:42:18.258 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: e1 2024-09-13T05:42:18.259 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: btime 2024-09-13T05:42:11:461872+0000 2024-09-13T05:42:18.259 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T05:42:18.259 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T05:42:18.259 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: legacy client fscid: -1 2024-09-13T05:42:18.259 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: 2024-09-13T05:42:18.259 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: No filesystems configured 2024-09-13T05:42:18.259 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.016+0000 7f1d7d350c80 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T05:42:18.259 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.016+0000 7f1d7d350c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T05:42:18.259 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.016+0000 7f1d7d350c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T05:42:18.259 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.016+0000 7f1d7d350c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T05:42:18.259 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: debug 2024-09-13T05:42:18.020+0000 7f1d7d350c80 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T05:42:18.259 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028134+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T05:42:18.259 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028134+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T05:42:18.260 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028199+0000 mon.a (mon.0) 2 : cluster [DBG] monmap epoch 1 2024-09-13T05:42:18.260 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028199+0000 mon.a (mon.0) 2 : cluster [DBG] monmap epoch 1 2024-09-13T05:42:18.260 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028216+0000 mon.a (mon.0) 3 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:18.260 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028216+0000 mon.a (mon.0) 3 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:18.260 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028228+0000 mon.a (mon.0) 4 : cluster [DBG] last_changed 2024-09-13T05:42:06.711537+0000 2024-09-13T05:42:18.260 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028228+0000 mon.a (mon.0) 4 : cluster [DBG] last_changed 2024-09-13T05:42:06.711537+0000 2024-09-13T05:42:18.260 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028241+0000 mon.a (mon.0) 5 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:42:18.260 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028241+0000 mon.a (mon.0) 5 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:42:18.260 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028254+0000 mon.a (mon.0) 6 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:42:18.260 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028254+0000 mon.a (mon.0) 6 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:42:18.260 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028266+0000 mon.a (mon.0) 7 : cluster [DBG] election_strategy: 1 2024-09-13T05:42:18.260 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028266+0000 mon.a (mon.0) 7 : cluster [DBG] election_strategy: 1 2024-09-13T05:42:18.260 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028281+0000 mon.a (mon.0) 8 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:42:18.261 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028281+0000 mon.a (mon.0) 8 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:42:18.261 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028715+0000 mon.a (mon.0) 9 : cluster [DBG] fsmap 2024-09-13T05:42:18.261 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028715+0000 mon.a (mon.0) 9 : cluster [DBG] fsmap 2024-09-13T05:42:18.261 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028752+0000 mon.a (mon.0) 10 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-13T05:42:18.261 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.028752+0000 mon.a (mon.0) 10 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-13T05:42:18.261 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.029129+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e1: no daemons active 2024-09-13T05:42:18.261 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:18 smithi079 bash[22814]: cluster 2024-09-13T05:42:18.029129+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e1: no daemons active 2024-09-13T05:42:18.861 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.092+0000 7ff22488d640 1 Processor -- start 2024-09-13T05:42:18.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.092+0000 7ff22488d640 1 -- start start 2024-09-13T05:42:18.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.092+0000 7ff22488d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22007cd00 0x7ff22007b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:18.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.092+0000 7ff22488d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff22007d1b0 con 0x7ff22007cd00 2024-09-13T05:42:18.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.092+0000 7ff21e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22007cd00 0x7ff22007b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:18.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.092+0000 7ff21e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22007cd00 0x7ff22007b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39436/0 (socket says 172.21.15.79:39436) 2024-09-13T05:42:18.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.092+0000 7ff21e59c640 1 -- 172.21.15.79:0/3367719133 learned_addr learned my addr 172.21.15.79:0/3367719133 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:18.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.092+0000 7ff21e59c640 1 -- 172.21.15.79:0/3367719133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22007b8a0 con 0x7ff22007cd00 2024-09-13T05:42:18.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff21e59c640 1 --2- 172.21.15.79:0/3367719133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22007cd00 0x7ff22007b360 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff210009820 tx=0x7ff21002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6369222f88e3de72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:18.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff21d59a640 1 -- 172.21.15.79:0/3367719133 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff210037070 con 0x7ff22007cd00 2024-09-13T05:42:18.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff21d59a640 1 -- 172.21.15.79:0/3367719133 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7ff2100328a0 con 0x7ff22007cd00 2024-09-13T05:42:18.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff21d59a640 1 -- 172.21.15.79:0/3367719133 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff210030690 con 0x7ff22007cd00 2024-09-13T05:42:18.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff22488d640 1 -- 172.21.15.79:0/3367719133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22007cd00 msgr2=0x7ff22007b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff22488d640 1 --2- 172.21.15.79:0/3367719133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22007cd00 0x7ff22007b360 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff210009820 tx=0x7ff21002a270 comp rx=0 tx=0).stop 2024-09-13T05:42:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff22488d640 1 -- 172.21.15.79:0/3367719133 shutdown_connections 2024-09-13T05:42:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff22488d640 1 --2- 172.21.15.79:0/3367719133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22007cd00 0x7ff22007b360 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff22488d640 1 -- 172.21.15.79:0/3367719133 >> 172.21.15.79:0/3367719133 conn(0x7ff220102230 msgr2=0x7ff220104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff22488d640 1 -- 172.21.15.79:0/3367719133 shutdown_connections 2024-09-13T05:42:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff22488d640 1 -- 172.21.15.79:0/3367719133 wait complete. 2024-09-13T05:42:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff22488d640 1 Processor -- start 2024-09-13T05:42:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff22488d640 1 -- start start 2024-09-13T05:42:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff22488d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22007cd00 0x7ff22019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff22488d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff22010ce90 con 0x7ff22007cd00 2024-09-13T05:42:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff21e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22007cd00 0x7ff22019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff21e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22007cd00 0x7ff22019cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39452/0 (socket says 172.21.15.79:39452) 2024-09-13T05:42:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff21e59c640 1 -- 172.21.15.79:0/3190256806 learned_addr learned my addr 172.21.15.79:0/3190256806 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff21e59c640 1 -- 172.21.15.79:0/3190256806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22019d040 con 0x7ff22007cd00 2024-09-13T05:42:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.096+0000 7ff21e59c640 1 --2- 172.21.15.79:0/3190256806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22007cd00 0x7ff22019cae0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff210000c00 tx=0x7ff210032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.100+0000 7ff2177fe640 1 -- 172.21.15.79:0/3190256806 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff210037040 con 0x7ff22007cd00 2024-09-13T05:42:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.100+0000 7ff2177fe640 1 -- 172.21.15.79:0/3190256806 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7ff210040070 con 0x7ff22007cd00 2024-09-13T05:42:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.100+0000 7ff22488d640 1 -- 172.21.15.79:0/3190256806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22019d2d0 con 0x7ff22007cd00 2024-09-13T05:42:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.100+0000 7ff2177fe640 1 -- 172.21.15.79:0/3190256806 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff21003be40 con 0x7ff22007cd00 2024-09-13T05:42:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.100+0000 7ff22488d640 1 -- 172.21.15.79:0/3190256806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff22019dc90 con 0x7ff22007cd00 2024-09-13T05:42:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.100+0000 7ff2177fe640 1 -- 172.21.15.79:0/3190256806 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff210045460 con 0x7ff22007cd00 2024-09-13T05:42:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.100+0000 7ff2177fe640 1 -- 172.21.15.79:0/3190256806 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff21003a750 con 0x7ff22007cd00 2024-09-13T05:42:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.100+0000 7ff22488d640 1 -- 172.21.15.79:0/3190256806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff22007b3e0 con 0x7ff22007cd00 2024-09-13T05:42:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.100+0000 7ff2177fe640 1 -- 172.21.15.79:0/3190256806 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff21003b430 con 0x7ff22007cd00 2024-09-13T05:42:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.220+0000 7ff22488d640 1 -- 172.21.15.79:0/3190256806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7ff22019e210 con 0x7ff22007cd00 2024-09-13T05:42:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.228+0000 7ff2177fe640 1 -- 172.21.15.79:0/3190256806 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 169+0+0 (secure 0 0 0) 0x7ff21003b680 con 0x7ff22007cd00 2024-09-13T05:42:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.228+0000 7ff22488d640 1 -- 172.21.15.79:0/3190256806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22007cd00 msgr2=0x7ff22019cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:18.865 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.228+0000 7ff22488d640 1 --2- 172.21.15.79:0/3190256806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22007cd00 0x7ff22019cae0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff210000c00 tx=0x7ff210032740 comp rx=0 tx=0).stop 2024-09-13T05:42:18.865 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.228+0000 7ff22488d640 1 -- 172.21.15.79:0/3190256806 shutdown_connections 2024-09-13T05:42:18.865 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.228+0000 7ff22488d640 1 --2- 172.21.15.79:0/3190256806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff22007cd00 0x7ff22019cae0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:18.865 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.228+0000 7ff22488d640 1 -- 172.21.15.79:0/3190256806 >> 172.21.15.79:0/3190256806 conn(0x7ff220102230 msgr2=0x7ff220102d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:18.865 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.228+0000 7ff22488d640 1 -- 172.21.15.79:0/3190256806 shutdown_connections 2024-09-13T05:42:18.865 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:18.228+0000 7ff22488d640 1 -- 172.21.15.79:0/3190256806 wait complete. 2024-09-13T05:42:18.865 INFO:teuthology.orchestra.run.smithi079.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T05:42:18.884 INFO:teuthology.orchestra.run.smithi079.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T05:42:18.884 INFO:teuthology.orchestra.run.smithi079.stdout:Creating mgr... 2024-09-13T05:42:18.885 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T05:42:18.885 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T05:42:19.226 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:19 smithi079 systemd[1]: /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T05:42:19.237 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bf551932-7192-11ef-bceb-c7b262605968@mgr.y 2024-09-13T05:42:19.237 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bf551932-7192-11ef-bceb-c7b262605968@mgr.y.service: Unit ceph-bf551932-7192-11ef-bceb-c7b262605968@mgr.y.service not loaded. 2024-09-13T05:42:19.435 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968.target.wants/ceph-bf551932-7192-11ef-bceb-c7b262605968@mgr.y.service -> /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968@.service. 2024-09-13T05:42:19.444 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld does not appear to be present 2024-09-13T05:42:19.445 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T05:42:19.445 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld does not appear to be present 2024-09-13T05:42:19.445 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-13T05:42:19.445 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr to start... 2024-09-13T05:42:19.445 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr... 2024-09-13T05:42:19.484 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:19 smithi079 systemd[1]: Started Ceph mgr.y for bf551932-7192-11ef-bceb-c7b262605968. 2024-09-13T05:42:19.485 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:19 smithi079 bash[22814]: audit 2024-09-13T05:42:18.231590+0000 mon.a (mon.0) 12 : audit [INF] from='client.? 172.21.15.79:0/3190256806' entity='client.admin' 2024-09-13T05:42:19.485 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:19 smithi079 bash[22814]: audit 2024-09-13T05:42:18.231590+0000 mon.a (mon.0) 12 : audit [INF] from='client.? 172.21.15.79:0/3190256806' entity='client.admin' 2024-09-13T05:42:19.485 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:19 smithi079 systemd[1]: /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T05:42:21.735 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:21 smithi079 bash[22814]: audit 2024-09-13T05:42:21.289567+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.79:0/1168234569' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-13T05:42:21.735 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:21 smithi079 bash[22814]: audit 2024-09-13T05:42:21.289567+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.79:0/1168234569' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-13T05:42:21.941 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-13T05:42:21.942 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-13T05:42:21.942 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsid": "bf551932-7192-11ef-bceb-c7b262605968", 2024-09-13T05:42:21.942 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T05:42:21.942 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T05:42:21.942 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T05:42:21.942 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T05:42:21.942 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:21.942 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T05:42:21.942 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T05:42:21.942 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 0 2024-09-13T05:42:21.942 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-13T05:42:21.942 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T05:42:21.943 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T05:42:21.943 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-13T05:42:21.943 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-13T05:42:21.943 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T05:42:21.943 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T05:42:21.943 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-13T05:42:21.943 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T05:42:21.943 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:21.943 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T05:42:21.943 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T05:42:21.943 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T05:42:21.943 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T05:42:21.943 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T05:42:21.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T05:42:21.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T05:42:21.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T05:42:21.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:21.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T05:42:21.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T05:42:21.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T05:42:21.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T05:42:21.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T05:42:21.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T05:42:21.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T05:42:21.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T05:42:21.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T05:42:21.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:21.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T05:42:21.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T05:42:21.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "btime": "2024-09-13T05:42:11:461872+0000", 2024-09-13T05:42:21.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T05:42:21.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T05:42:21.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:21.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T05:42:21.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T05:42:21.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T05:42:21.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T05:42:21.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T05:42:21.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T05:42:21.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T05:42:21.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-13T05:42:21.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T05:42:21.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:21.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T05:42:21.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T05:42:21.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T05:42:11.462534+0000", 2024-09-13T05:42:21.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T05:42:21.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:21.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T05:42:21.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-13T05:42:21.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.152+0000 7fc6c1f73640 1 Processor -- start 2024-09-13T05:42:21.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.152+0000 7fc6c1f73640 1 -- start start 2024-09-13T05:42:21.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.152+0000 7fc6c1f73640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6bc07a440 0x7fc6bc109520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:21.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.152+0000 7fc6c1f73640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc109a60 con 0x7fc6bc07a440 2024-09-13T05:42:21.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.152+0000 7fc6bb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6bc07a440 0x7fc6bc109520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:21.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.152+0000 7fc6bb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6bc07a440 0x7fc6bc109520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39482/0 (socket says 172.21.15.79:39482) 2024-09-13T05:42:21.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.152+0000 7fc6bb7fe640 1 -- 172.21.15.79:0/3547253773 learned_addr learned my addr 172.21.15.79:0/3547253773 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:21.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.152+0000 7fc6bb7fe640 1 -- 172.21.15.79:0/3547253773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc109be0 con 0x7fc6bc07a440 2024-09-13T05:42:21.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6bb7fe640 1 --2- 172.21.15.79:0/3547253773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6bc07a440 0x7fc6bc109520 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009820 tx=0x7fc6b002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2473c984c997b67d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6ba7fc640 1 -- 172.21.15.79:0/3547253773 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6b0037070 con 0x7fc6bc07a440 2024-09-13T05:42:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6ba7fc640 1 -- 172.21.15.79:0/3547253773 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fc6b00328a0 con 0x7fc6bc07a440 2024-09-13T05:42:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6ba7fc640 1 -- 172.21.15.79:0/3547253773 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6b0030710 con 0x7fc6bc07a440 2024-09-13T05:42:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6c1f73640 1 -- 172.21.15.79:0/3547253773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6bc07a440 msgr2=0x7fc6bc109520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6c1f73640 1 --2- 172.21.15.79:0/3547253773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6bc07a440 0x7fc6bc109520 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009820 tx=0x7fc6b002a300 comp rx=0 tx=0).stop 2024-09-13T05:42:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6c1f73640 1 -- 172.21.15.79:0/3547253773 shutdown_connections 2024-09-13T05:42:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6c1f73640 1 --2- 172.21.15.79:0/3547253773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6bc07a440 0x7fc6bc109520 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6c1f73640 1 -- 172.21.15.79:0/3547253773 >> 172.21.15.79:0/3547253773 conn(0x7fc6bc1011b0 msgr2=0x7fc6bc1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6c1f73640 1 -- 172.21.15.79:0/3547253773 shutdown_connections 2024-09-13T05:42:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6c1f73640 1 -- 172.21.15.79:0/3547253773 wait complete. 2024-09-13T05:42:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6c1f73640 1 Processor -- start 2024-09-13T05:42:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6c1f73640 1 -- start start 2024-09-13T05:42:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6c1f73640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6bc07a440 0x7fc6bc19a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6c1f73640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc10aca0 con 0x7fc6bc07a440 2024-09-13T05:42:21.956 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6bb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6bc07a440 0x7fc6bc19a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:21.956 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6bb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6bc07a440 0x7fc6bc19a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39486/0 (socket says 172.21.15.79:39486) 2024-09-13T05:42:21.956 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6bb7fe640 1 -- 172.21.15.79:0/1168234569 learned_addr learned my addr 172.21.15.79:0/1168234569 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:21.956 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6bb7fe640 1 -- 172.21.15.79:0/1168234569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc19ae20 con 0x7fc6bc07a440 2024-09-13T05:42:21.956 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6bb7fe640 1 --2- 172.21.15.79:0/1168234569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6bc07a440 0x7fc6bc19a8c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0000c00 tx=0x7fc6b0030800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:21.956 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6b8ff9640 1 -- 172.21.15.79:0/1168234569 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6b0037040 con 0x7fc6bc07a440 2024-09-13T05:42:21.956 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6b8ff9640 1 -- 172.21.15.79:0/1168234569 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fc6b0040070 con 0x7fc6bc07a440 2024-09-13T05:42:21.956 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6c1f73640 1 -- 172.21.15.79:0/1168234569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6bc19b0b0 con 0x7fc6bc07a440 2024-09-13T05:42:21.956 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6b8ff9640 1 -- 172.21.15.79:0/1168234569 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6b003bdf0 con 0x7fc6bc07a440 2024-09-13T05:42:21.956 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6c1f73640 1 -- 172.21.15.79:0/1168234569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6bc19ba70 con 0x7fc6bc07a440 2024-09-13T05:42:21.956 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6b8ff9640 1 -- 172.21.15.79:0/1168234569 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc6b0045460 con 0x7fc6bc07a440 2024-09-13T05:42:21.956 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.156+0000 7fc6b8ff9640 1 -- 172.21.15.79:0/1168234569 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc6b0044730 con 0x7fc6bc07a440 2024-09-13T05:42:21.956 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.160+0000 7fc6c1f73640 1 -- 172.21.15.79:0/1168234569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6bc107590 con 0x7fc6bc07a440 2024-09-13T05:42:21.957 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.160+0000 7fc6b8ff9640 1 -- 172.21.15.79:0/1168234569 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc6b003b630 con 0x7fc6bc07a440 2024-09-13T05:42:21.957 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.284+0000 7fc6c1f73640 1 -- 172.21.15.79:0/1168234569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc6bc19bff0 con 0x7fc6bc07a440 2024-09-13T05:42:21.957 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.284+0000 7fc6b8ff9640 1 -- 172.21.15.79:0/1168234569 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fc6b003b810 con 0x7fc6bc07a440 2024-09-13T05:42:21.957 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.284+0000 7fc6c1f73640 1 -- 172.21.15.79:0/1168234569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6bc07a440 msgr2=0x7fc6bc19a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:21.957 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.284+0000 7fc6c1f73640 1 --2- 172.21.15.79:0/1168234569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6bc07a440 0x7fc6bc19a8c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0000c00 tx=0x7fc6b0030800 comp rx=0 tx=0).stop 2024-09-13T05:42:21.957 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.288+0000 7fc6c1f73640 1 -- 172.21.15.79:0/1168234569 shutdown_connections 2024-09-13T05:42:21.957 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.288+0000 7fc6c1f73640 1 --2- 172.21.15.79:0/1168234569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6bc07a440 0x7fc6bc19a8c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:21.957 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.288+0000 7fc6c1f73640 1 -- 172.21.15.79:0/1168234569 >> 172.21.15.79:0/1168234569 conn(0x7fc6bc1011b0 msgr2=0x7fc6bc101ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:21.957 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.288+0000 7fc6c1f73640 1 -- 172.21.15.79:0/1168234569 shutdown_connections 2024-09-13T05:42:21.957 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:21.288+0000 7fc6c1f73640 1 -- 172.21.15.79:0/1168234569 wait complete. 2024-09-13T05:42:21.957 INFO:teuthology.orchestra.run.smithi079.stdout:mgr not available, waiting (1/15)... 2024-09-13T05:42:25.485 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:25 smithi079 bash[22814]: audit 2024-09-13T05:42:25.206788+0000 mon.a (mon.0) 14 : audit [DBG] from='client.? 172.21.15.79:0/1511774813' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-13T05:42:25.485 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:25 smithi079 bash[22814]: audit 2024-09-13T05:42:25.206788+0000 mon.a (mon.0) 14 : audit [DBG] from='client.? 172.21.15.79:0/1511774813' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-13T05:42:25.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-13T05:42:25.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-13T05:42:25.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsid": "bf551932-7192-11ef-bceb-c7b262605968", 2024-09-13T05:42:25.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T05:42:25.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T05:42:25.774 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T05:42:25.774 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T05:42:25.774 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:25.774 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T05:42:25.774 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T05:42:25.774 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 0 2024-09-13T05:42:25.774 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-13T05:42:25.774 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T05:42:25.774 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T05:42:25.774 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-13T05:42:25.774 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-09-13T05:42:25.774 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T05:42:25.774 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T05:42:25.774 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-13T05:42:25.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T05:42:25.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:25.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T05:42:25.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T05:42:25.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T05:42:25.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T05:42:25.775 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T05:42:25.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T05:42:25.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T05:42:25.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T05:42:25.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:25.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T05:42:25.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T05:42:25.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T05:42:25.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T05:42:25.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T05:42:25.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T05:42:25.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T05:42:25.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T05:42:25.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T05:42:25.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:25.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T05:42:25.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T05:42:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "btime": "2024-09-13T05:42:11:461872+0000", 2024-09-13T05:42:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T05:42:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T05:42:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T05:42:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T05:42:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T05:42:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T05:42:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T05:42:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T05:42:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T05:42:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-13T05:42:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T05:42:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T05:42:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T05:42:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T05:42:11.462534+0000", 2024-09-13T05:42:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T05:42:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T05:42:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-13T05:42:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.068+0000 7f74c9aea640 1 Processor -- start 2024-09-13T05:42:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.068+0000 7f74c9aea640 1 -- start start 2024-09-13T05:42:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.068+0000 7f74c9aea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74c407a3c0 0x7f74c41095a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.068+0000 7f74c9aea640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f74c4109ae0 con 0x7f74c407a3c0 2024-09-13T05:42:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.068+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74c407a3c0 0x7f74c41095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.068+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74c407a3c0 0x7f74c41095a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47568/0 (socket says 172.21.15.79:47568) 2024-09-13T05:42:25.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.068+0000 7f74c37fe640 1 -- 172.21.15.79:0/2091859464 learned_addr learned my addr 172.21.15.79:0/2091859464 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:25.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.068+0000 7f74c37fe640 1 -- 172.21.15.79:0/2091859464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c4109c60 con 0x7f74c407a3c0 2024-09-13T05:42:25.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.068+0000 7f74c37fe640 1 --2- 172.21.15.79:0/2091859464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74c407a3c0 0x7f74c41095a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009820 tx=0x7f74ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b357dab5ce8a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:25.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c27fc640 1 -- 172.21.15.79:0/2091859464 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74ac037070 con 0x7f74c407a3c0 2024-09-13T05:42:25.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c27fc640 1 -- 172.21.15.79:0/2091859464 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f74ac0328a0 con 0x7f74c407a3c0 2024-09-13T05:42:25.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c27fc640 1 -- 172.21.15.79:0/2091859464 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74ac030690 con 0x7f74c407a3c0 2024-09-13T05:42:25.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c9aea640 1 -- 172.21.15.79:0/2091859464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74c407a3c0 msgr2=0x7f74c41095a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:25.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c9aea640 1 --2- 172.21.15.79:0/2091859464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74c407a3c0 0x7f74c41095a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009820 tx=0x7f74ac02a270 comp rx=0 tx=0).stop 2024-09-13T05:42:25.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c9aea640 1 -- 172.21.15.79:0/2091859464 shutdown_connections 2024-09-13T05:42:25.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c9aea640 1 --2- 172.21.15.79:0/2091859464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74c407a3c0 0x7f74c41095a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:25.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c9aea640 1 -- 172.21.15.79:0/2091859464 >> 172.21.15.79:0/2091859464 conn(0x7f74c41011b0 msgr2=0x7f74c41035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:25.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c9aea640 1 -- 172.21.15.79:0/2091859464 shutdown_connections 2024-09-13T05:42:25.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c9aea640 1 -- 172.21.15.79:0/2091859464 wait complete. 2024-09-13T05:42:25.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c9aea640 1 Processor -- start 2024-09-13T05:42:25.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c9aea640 1 -- start start 2024-09-13T05:42:25.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c9aea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74c407a3c0 0x7f74c419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:25.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c9aea640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f74c410acc0 con 0x7f74c407a3c0 2024-09-13T05:42:25.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74c407a3c0 0x7f74c419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:25.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74c407a3c0 0x7f74c419a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47580/0 (socket says 172.21.15.79:47580) 2024-09-13T05:42:25.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c37fe640 1 -- 172.21.15.79:0/1511774813 learned_addr learned my addr 172.21.15.79:0/1511774813 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:25.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c37fe640 1 -- 172.21.15.79:0/1511774813 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c419adf0 con 0x7f74c407a3c0 2024-09-13T05:42:25.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c37fe640 1 --2- 172.21.15.79:0/1511774813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74c407a3c0 0x7f74c419a890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f74ac006f10 tx=0x7f74ac032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:25.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c0ff9640 1 -- 172.21.15.79:0/1511774813 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74ac037040 con 0x7f74c407a3c0 2024-09-13T05:42:25.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c0ff9640 1 -- 172.21.15.79:0/1511774813 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f74ac040070 con 0x7f74c407a3c0 2024-09-13T05:42:25.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c0ff9640 1 -- 172.21.15.79:0/1511774813 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74ac03a390 con 0x7f74c407a3c0 2024-09-13T05:42:25.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c9aea640 1 -- 172.21.15.79:0/1511774813 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c419b080 con 0x7f74c407a3c0 2024-09-13T05:42:25.788 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c9aea640 1 -- 172.21.15.79:0/1511774813 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c419ba40 con 0x7f74c407a3c0 2024-09-13T05:42:25.788 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c0ff9640 1 -- 172.21.15.79:0/1511774813 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f74ac03a600 con 0x7f74c407a3c0 2024-09-13T05:42:25.788 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.072+0000 7f74c0ff9640 1 -- 172.21.15.79:0/1511774813 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f74ac045770 con 0x7f74c407a3c0 2024-09-13T05:42:25.788 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.076+0000 7f74c9aea640 1 -- 172.21.15.79:0/1511774813 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c4107610 con 0x7f74c407a3c0 2024-09-13T05:42:25.788 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.076+0000 7f74c0ff9640 1 -- 172.21.15.79:0/1511774813 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f74ac032830 con 0x7f74c407a3c0 2024-09-13T05:42:25.788 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.200+0000 7f74c9aea640 1 -- 172.21.15.79:0/1511774813 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f74c419bff0 con 0x7f74c407a3c0 2024-09-13T05:42:25.788 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.204+0000 7f74c0ff9640 1 -- 172.21.15.79:0/1511774813 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f74ac03b430 con 0x7f74c407a3c0 2024-09-13T05:42:25.788 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.204+0000 7f74c9aea640 1 -- 172.21.15.79:0/1511774813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74c407a3c0 msgr2=0x7f74c419a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:25.788 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.204+0000 7f74c9aea640 1 --2- 172.21.15.79:0/1511774813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74c407a3c0 0x7f74c419a890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f74ac006f10 tx=0x7f74ac032670 comp rx=0 tx=0).stop 2024-09-13T05:42:25.789 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.204+0000 7f74c9aea640 1 -- 172.21.15.79:0/1511774813 shutdown_connections 2024-09-13T05:42:25.789 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.204+0000 7f74c9aea640 1 --2- 172.21.15.79:0/1511774813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74c407a3c0 0x7f74c419a890 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:25.789 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.204+0000 7f74c9aea640 1 -- 172.21.15.79:0/1511774813 >> 172.21.15.79:0/1511774813 conn(0x7f74c41011b0 msgr2=0x7f74c4101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:25.789 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.204+0000 7f74c9aea640 1 -- 172.21.15.79:0/1511774813 shutdown_connections 2024-09-13T05:42:25.789 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:25.204+0000 7f74c9aea640 1 -- 172.21.15.79:0/1511774813 wait complete. 2024-09-13T05:42:25.789 INFO:teuthology.orchestra.run.smithi079.stdout:mgr not available, waiting (2/15)... 2024-09-13T05:42:27.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: cluster 2024-09-13T05:42:26.997810+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon y 2024-09-13T05:42:27.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: cluster 2024-09-13T05:42:26.997810+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon y 2024-09-13T05:42:27.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: cluster 2024-09-13T05:42:27.005794+0000 mon.a (mon.0) 16 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00854371s) 2024-09-13T05:42:27.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: cluster 2024-09-13T05:42:27.005794+0000 mon.a (mon.0) 16 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00854371s) 2024-09-13T05:42:27.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: audit 2024-09-13T05:42:27.006826+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-13T05:42:27.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: audit 2024-09-13T05:42:27.006826+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-13T05:42:27.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: audit 2024-09-13T05:42:27.006955+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-13T05:42:27.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: audit 2024-09-13T05:42:27.006955+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-13T05:42:27.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: audit 2024-09-13T05:42:27.007078+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-13T05:42:27.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: audit 2024-09-13T05:42:27.007078+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-13T05:42:27.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: audit 2024-09-13T05:42:27.007185+0000 mon.a (mon.0) 20 : audit [DBG] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:42:27.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: audit 2024-09-13T05:42:27.007185+0000 mon.a (mon.0) 20 : audit [DBG] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:42:27.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: audit 2024-09-13T05:42:27.008637+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-13T05:42:27.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: audit 2024-09-13T05:42:27.008637+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-13T05:42:27.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: cluster 2024-09-13T05:42:27.033571+0000 mon.a (mon.0) 22 : cluster [INF] Manager daemon y is now available 2024-09-13T05:42:27.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: cluster 2024-09-13T05:42:27.033571+0000 mon.a (mon.0) 22 : cluster [INF] Manager daemon y is now available 2024-09-13T05:42:27.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: audit 2024-09-13T05:42:27.043730+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-13T05:42:27.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: audit 2024-09-13T05:42:27.043730+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-13T05:42:27.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: audit 2024-09-13T05:42:27.045207+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-13T05:42:27.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:27 smithi079 bash[22814]: audit 2024-09-13T05:42:27.045207+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-13T05:42:28.235 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:28 smithi079 bash[22814]: audit 2024-09-13T05:42:27.048893+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' 2024-09-13T05:42:28.235 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:28 smithi079 bash[22814]: audit 2024-09-13T05:42:27.048893+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' 2024-09-13T05:42:28.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:28 smithi079 bash[22814]: audit 2024-09-13T05:42:27.061502+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' 2024-09-13T05:42:28.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:28 smithi079 bash[22814]: audit 2024-09-13T05:42:27.061502+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' 2024-09-13T05:42:28.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:28 smithi079 bash[22814]: audit 2024-09-13T05:42:27.066969+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' 2024-09-13T05:42:28.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:28 smithi079 bash[22814]: audit 2024-09-13T05:42:27.066969+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.15.79:0/1191541963' entity='mgr.y' 2024-09-13T05:42:28.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:28 smithi079 bash[22814]: cluster 2024-09-13T05:42:28.012726+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e3: y(active, since 1.01548s) 2024-09-13T05:42:28.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:28 smithi079 bash[22814]: cluster 2024-09-13T05:42:28.012726+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e3: y(active, since 1.01548s) 2024-09-13T05:42:30.030 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-13T05:42:30.031 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-13T05:42:30.031 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsid": "bf551932-7192-11ef-bceb-c7b262605968", 2024-09-13T05:42:30.031 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T05:42:30.031 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T05:42:30.031 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T05:42:30.031 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T05:42:30.031 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:30.031 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T05:42:30.031 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T05:42:30.031 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 0 2024-09-13T05:42:30.031 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-13T05:42:30.031 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T05:42:30.031 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T05:42:30.032 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-13T05:42:30.032 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-13T05:42:30.032 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T05:42:30.032 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T05:42:30.032 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-13T05:42:30.032 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T05:42:30.032 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:30.032 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T05:42:30.032 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T05:42:30.032 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T05:42:30.032 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T05:42:30.032 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T05:42:30.041 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T05:42:30.041 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T05:42:30.041 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T05:42:30.041 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:30.041 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T05:42:30.041 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T05:42:30.041 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T05:42:30.041 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T05:42:30.042 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T05:42:30.042 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T05:42:30.042 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T05:42:30.042 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T05:42:30.042 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T05:42:30.042 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:30.042 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T05:42:30.042 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T05:42:30.042 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "btime": "2024-09-13T05:42:11:461872+0000", 2024-09-13T05:42:30.043 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T05:42:30.043 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T05:42:30.043 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:30.043 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T05:42:30.043 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T05:42:30.043 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T05:42:30.043 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T05:42:30.043 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T05:42:30.043 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T05:42:30.043 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T05:42:30.043 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-13T05:42:30.043 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T05:42:30.043 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:30.044 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T05:42:30.044 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T05:42:30.044 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T05:42:11.462534+0000", 2024-09-13T05:42:30.044 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T05:42:30.044 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-13T05:42:30.044 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T05:42:30.044 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-13T05:42:30.044 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.015+0000 7fd7e0fbc640 1 Processor -- start 2024-09-13T05:42:30.044 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.015+0000 7fd7e0fbc640 1 -- start start 2024-09-13T05:42:30.044 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.015+0000 7fd7e0fbc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7dc07cd20 0x7fd7dc07b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:30.044 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.015+0000 7fd7e0fbc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7dc07b8c0 con 0x7fd7dc07cd20 2024-09-13T05:42:30.044 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.015+0000 7fd7da59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7dc07cd20 0x7fd7dc07b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:30.044 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.015+0000 7fd7da59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7dc07cd20 0x7fd7dc07b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47654/0 (socket says 172.21.15.79:47654) 2024-09-13T05:42:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.015+0000 7fd7da59c640 1 -- 172.21.15.79:0/1920083015 learned_addr learned my addr 172.21.15.79:0/1920083015 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.015+0000 7fd7da59c640 1 -- 172.21.15.79:0/1920083015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7dc07ba40 con 0x7fd7dc07cd20 2024-09-13T05:42:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.015+0000 7fd7da59c640 1 --2- 172.21.15.79:0/1920083015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7dc07cd20 0x7fd7dc07b380 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009e80 tx=0x7fd7cc02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27d4617b3170d91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.015+0000 7fd7d959a640 1 -- 172.21.15.79:0/1920083015 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc036070 con 0x7fd7dc07cd20 2024-09-13T05:42:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.015+0000 7fd7d959a640 1 -- 172.21.15.79:0/1920083015 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fd7cc031860 con 0x7fd7dc07cd20 2024-09-13T05:42:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.015+0000 7fd7d959a640 1 -- 172.21.15.79:0/1920083015 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc007880 con 0x7fd7dc07cd20 2024-09-13T05:42:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/1920083015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7dc07cd20 msgr2=0x7fd7dc07b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7e0fbc640 1 --2- 172.21.15.79:0/1920083015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7dc07cd20 0x7fd7dc07b380 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009e80 tx=0x7fd7cc02a7a0 comp rx=0 tx=0).stop 2024-09-13T05:42:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/1920083015 shutdown_connections 2024-09-13T05:42:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7e0fbc640 1 --2- 172.21.15.79:0/1920083015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7dc07cd20 0x7fd7dc07b380 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/1920083015 >> 172.21.15.79:0/1920083015 conn(0x7fd7dc102240 msgr2=0x7fd7dc104660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/1920083015 shutdown_connections 2024-09-13T05:42:30.045 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/1920083015 wait complete. 2024-09-13T05:42:30.046 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7e0fbc640 1 Processor -- start 2024-09-13T05:42:30.046 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7e0fbc640 1 -- start start 2024-09-13T05:42:30.046 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7e0fbc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7dc07cd20 0x7fd7dc19ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:30.046 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7e0fbc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7dc10cea0 con 0x7fd7dc07cd20 2024-09-13T05:42:30.046 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7da59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7dc07cd20 0x7fd7dc19ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:30.046 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7da59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7dc07cd20 0x7fd7dc19ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47662/0 (socket says 172.21.15.79:47662) 2024-09-13T05:42:30.046 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7da59c640 1 -- 172.21.15.79:0/3528614278 learned_addr learned my addr 172.21.15.79:0/3528614278 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:30.046 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7da59c640 1 -- 172.21.15.79:0/3528614278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7dc19cfc0 con 0x7fd7dc07cd20 2024-09-13T05:42:30.046 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7da59c640 1 --2- 172.21.15.79:0/3528614278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7dc07cd20 0x7fd7dc19ca60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc008dc0 tx=0x7fd7cc008df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:30.046 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7cb7fe640 1 -- 172.21.15.79:0/3528614278 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc041020 con 0x7fd7dc07cd20 2024-09-13T05:42:30.046 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7cb7fe640 1 -- 172.21.15.79:0/3528614278 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fd7cc031a10 con 0x7fd7dc07cd20 2024-09-13T05:42:30.046 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/3528614278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7dc19d250 con 0x7fd7dc07cd20 2024-09-13T05:42:30.047 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7cb7fe640 1 -- 172.21.15.79:0/3528614278 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc036040 con 0x7fd7dc07cd20 2024-09-13T05:42:30.047 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/3528614278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7dc19dc90 con 0x7fd7dc07cd20 2024-09-13T05:42:30.047 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7cb7fe640 1 -- 172.21.15.79:0/3528614278 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 3) ==== 51613+0+0 (secure 0 0 0) 0x7fd7cc044020 con 0x7fd7dc07cd20 2024-09-13T05:42:30.047 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7cb7fe640 1 --2- 172.21.15.79:0/3528614278 >> v2:172.21.15.79:6800/784563831 conn(0x7fd7c403f250 0x7fd7c4041710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:30.047 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7cb7fe640 1 -- 172.21.15.79:0/3528614278 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd7cc079220 con 0x7fd7dc07cd20 2024-09-13T05:42:30.047 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.019+0000 7fd7d9d9b640 1 --2- 172.21.15.79:0/3528614278 >> v2:172.21.15.79:6800/784563831 conn(0x7fd7c403f250 0x7fd7c4041710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:30.047 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.023+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/3528614278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7dc07b400 con 0x7fd7dc07cd20 2024-09-13T05:42:30.047 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.023+0000 7fd7d9d9b640 1 --2- 172.21.15.79:0/3528614278 >> v2:172.21.15.79:6800/784563831 conn(0x7fd7c403f250 0x7fd7c4041710 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00098c0 tx=0x7fd7d0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:30.047 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.027+0000 7fd7cb7fe640 1 -- 172.21.15.79:0/3528614278 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7fd7cc03a370 con 0x7fd7dc07cd20 2024-09-13T05:42:30.047 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.055+0000 7fd7cb7fe640 1 -- 172.21.15.79:0/3528614278 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 4) ==== 51719+0+0 (secure 0 0 0) 0x7fd7cc046780 con 0x7fd7dc07cd20 2024-09-13T05:42:30.047 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.503+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/3528614278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd7dc19e210 con 0x7fd7dc07cd20 2024-09-13T05:42:30.047 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.503+0000 7fd7cb7fe640 1 -- 172.21.15.79:0/3528614278 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fd7cc035170 con 0x7fd7dc07cd20 2024-09-13T05:42:30.047 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.507+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/3528614278 >> v2:172.21.15.79:6800/784563831 conn(0x7fd7c403f250 msgr2=0x7fd7c4041710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:30.048 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.507+0000 7fd7e0fbc640 1 --2- 172.21.15.79:0/3528614278 >> v2:172.21.15.79:6800/784563831 conn(0x7fd7c403f250 0x7fd7c4041710 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00098c0 tx=0x7fd7d0006db0 comp rx=0 tx=0).stop 2024-09-13T05:42:30.048 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.507+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/3528614278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7dc07cd20 msgr2=0x7fd7dc19ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:30.048 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.507+0000 7fd7e0fbc640 1 --2- 172.21.15.79:0/3528614278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7dc07cd20 0x7fd7dc19ca60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc008dc0 tx=0x7fd7cc008df0 comp rx=0 tx=0).stop 2024-09-13T05:42:30.048 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.507+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/3528614278 shutdown_connections 2024-09-13T05:42:30.048 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.507+0000 7fd7e0fbc640 1 --2- 172.21.15.79:0/3528614278 >> v2:172.21.15.79:6800/784563831 conn(0x7fd7c403f250 0x7fd7c4041710 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:30.048 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.507+0000 7fd7e0fbc640 1 --2- 172.21.15.79:0/3528614278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7dc07cd20 0x7fd7dc19ca60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:30.048 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.507+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/3528614278 >> 172.21.15.79:0/3528614278 conn(0x7fd7dc102240 msgr2=0x7fd7dc102ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:30.048 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.507+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/3528614278 shutdown_connections 2024-09-13T05:42:30.048 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:29.507+0000 7fd7e0fbc640 1 -- 172.21.15.79:0/3528614278 wait complete. 2024-09-13T05:42:30.048 INFO:teuthology.orchestra.run.smithi079.stdout:mgr is available 2024-09-13T05:42:30.485 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:30 smithi079 bash[22814]: cluster 2024-09-13T05:42:29.060764+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e4: y(active, since 2s) 2024-09-13T05:42:30.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:30 smithi079 bash[22814]: cluster 2024-09-13T05:42:29.060764+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e4: y(active, since 2s) 2024-09-13T05:42:30.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:30 smithi079 bash[22814]: audit 2024-09-13T05:42:29.509324+0000 mon.a (mon.0) 30 : audit [DBG] from='client.? 172.21.15.79:0/3528614278' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-13T05:42:30.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:30 smithi079 bash[22814]: audit 2024-09-13T05:42:29.509324+0000 mon.a (mon.0) 30 : audit [DBG] from='client.? 172.21.15.79:0/3528614278' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-13T05:42:31.985 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:31 smithi079 bash[22814]: audit 2024-09-13T05:42:31.539573+0000 mon.a (mon.0) 31 : audit [INF] from='client.? 172.21.15.79:0/3044827655' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-13T05:42:31.986 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:31 smithi079 bash[22814]: audit 2024-09-13T05:42:31.539573+0000 mon.a (mon.0) 31 : audit [INF] from='client.? 172.21.15.79:0/3044827655' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-13T05:42:32.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-13T05:42:32.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T05:42:32.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout fsid = bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:32.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-13T05:42:32.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.79:3300,v1:172.21.15.79:6789] 2024-09-13T05:42:32.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T05:42:32.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T05:42:32.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T05:42:32.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T05:42:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-13T05:42:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T05:42:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T05:42:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-13T05:42:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T05:42:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T05:42:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T05:42:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.179+0000 7f825c165640 1 Processor -- start 2024-09-13T05:42:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.179+0000 7f825c165640 1 -- start start 2024-09-13T05:42:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.179+0000 7f825c165640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f825407a440 0x7f8254109520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.179+0000 7f825c165640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8254109a60 con 0x7f825407a440 2024-09-13T05:42:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.179+0000 7f8259f01640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f825407a440 0x7f8254109520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.179+0000 7f8259f01640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f825407a440 0x7f8254109520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47672/0 (socket says 172.21.15.79:47672) 2024-09-13T05:42:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.179+0000 7f8259f01640 1 -- 172.21.15.79:0/659124187 learned_addr learned my addr 172.21.15.79:0/659124187 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:32.160 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.179+0000 7f8259f01640 1 -- 172.21.15.79:0/659124187 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8254109be0 con 0x7f825407a440 2024-09-13T05:42:32.160 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f8259f01640 1 --2- 172.21.15.79:0/659124187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f825407a440 0x7f8254109520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8250009820 tx=0x7f825002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a614cb14a5f0a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:32.160 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f8258eff640 1 -- 172.21.15.79:0/659124187 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8250037070 con 0x7f825407a440 2024-09-13T05:42:32.160 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f8258eff640 1 -- 172.21.15.79:0/659124187 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f82500328a0 con 0x7f825407a440 2024-09-13T05:42:32.160 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f8258eff640 1 -- 172.21.15.79:0/659124187 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8250030710 con 0x7f825407a440 2024-09-13T05:42:32.160 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f825c165640 1 -- 172.21.15.79:0/659124187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f825407a440 msgr2=0x7f8254109520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:32.160 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f825c165640 1 --2- 172.21.15.79:0/659124187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f825407a440 0x7f8254109520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8250009820 tx=0x7f825002a300 comp rx=0 tx=0).stop 2024-09-13T05:42:32.160 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f825c165640 1 -- 172.21.15.79:0/659124187 shutdown_connections 2024-09-13T05:42:32.160 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f825c165640 1 --2- 172.21.15.79:0/659124187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f825407a440 0x7f8254109520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:32.160 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f825c165640 1 -- 172.21.15.79:0/659124187 >> 172.21.15.79:0/659124187 conn(0x7f82541011b0 msgr2=0x7f82541035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:32.160 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f825c165640 1 -- 172.21.15.79:0/659124187 shutdown_connections 2024-09-13T05:42:32.160 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f825c165640 1 -- 172.21.15.79:0/659124187 wait complete. 2024-09-13T05:42:32.161 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f825c165640 1 Processor -- start 2024-09-13T05:42:32.161 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f825c165640 1 -- start start 2024-09-13T05:42:32.161 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f825c165640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f825407a440 0x7f8254106b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:32.161 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f825c165640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f825410aca0 con 0x7f825407a440 2024-09-13T05:42:32.161 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f8259f01640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f825407a440 0x7f8254106b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:32.161 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f8259f01640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f825407a440 0x7f8254106b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47684/0 (socket says 172.21.15.79:47684) 2024-09-13T05:42:32.161 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f8259f01640 1 -- 172.21.15.79:0/3044827655 learned_addr learned my addr 172.21.15.79:0/3044827655 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:32.161 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f8259f01640 1 -- 172.21.15.79:0/3044827655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82541070d0 con 0x7f825407a440 2024-09-13T05:42:32.161 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f8259f01640 1 --2- 172.21.15.79:0/3044827655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f825407a440 0x7f8254106b70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8250030460 tx=0x7f8250030710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:32.161 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f824affd640 1 -- 172.21.15.79:0/3044827655 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8250037040 con 0x7f825407a440 2024-09-13T05:42:32.161 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f824affd640 1 -- 172.21.15.79:0/3044827655 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f8250040070 con 0x7f825407a440 2024-09-13T05:42:32.161 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f825c165640 1 -- 172.21.15.79:0/3044827655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82541054c0 con 0x7f825407a440 2024-09-13T05:42:32.161 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f824affd640 1 -- 172.21.15.79:0/3044827655 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f825003be30 con 0x7f825407a440 2024-09-13T05:42:32.161 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.183+0000 7f825c165640 1 -- 172.21.15.79:0/3044827655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8254105a40 con 0x7f825407a440 2024-09-13T05:42:32.162 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.187+0000 7f824affd640 1 -- 172.21.15.79:0/3044827655 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) ==== 51719+0+0 (secure 0 0 0) 0x7f8250045460 con 0x7f825407a440 2024-09-13T05:42:32.162 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.187+0000 7f825c165640 1 -- 172.21.15.79:0/3044827655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8254107590 con 0x7f825407a440 2024-09-13T05:42:32.162 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.187+0000 7f824affd640 1 --2- 172.21.15.79:0/3044827655 >> v2:172.21.15.79:6800/784563831 conn(0x7f824003f630 0x7f8240041af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:32.162 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.187+0000 7f824affd640 1 -- 172.21.15.79:0/3044827655 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8250073d90 con 0x7f825407a440 2024-09-13T05:42:32.162 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.187+0000 7f8259700640 1 --2- 172.21.15.79:0/3044827655 >> v2:172.21.15.79:6800/784563831 conn(0x7f824003f630 0x7f8240041af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:32.162 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.187+0000 7f8259700640 1 --2- 172.21.15.79:0/3044827655 >> v2:172.21.15.79:6800/784563831 conn(0x7f824003f630 0x7f8240041af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f82440098c0 tx=0x7f8244006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:32.162 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.191+0000 7f824affd640 1 -- 172.21.15.79:0/3044827655 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f8250043c60 con 0x7f825407a440 2024-09-13T05:42:32.162 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.531+0000 7f825c165640 1 -- 172.21.15.79:0/3044827655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f8254106010 con 0x7f825407a440 2024-09-13T05:42:32.162 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.535+0000 7f824affd640 1 -- 172.21.15.79:0/3044827655 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+374 (secure 0 0 0) 0x7f8250073af0 con 0x7f825407a440 2024-09-13T05:42:32.162 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.539+0000 7f825c165640 1 -- 172.21.15.79:0/3044827655 >> v2:172.21.15.79:6800/784563831 conn(0x7f824003f630 msgr2=0x7f8240041af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:32.162 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.539+0000 7f825c165640 1 --2- 172.21.15.79:0/3044827655 >> v2:172.21.15.79:6800/784563831 conn(0x7f824003f630 0x7f8240041af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f82440098c0 tx=0x7f8244006db0 comp rx=0 tx=0).stop 2024-09-13T05:42:32.162 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.539+0000 7f825c165640 1 -- 172.21.15.79:0/3044827655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f825407a440 msgr2=0x7f8254106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:32.162 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.539+0000 7f825c165640 1 --2- 172.21.15.79:0/3044827655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f825407a440 0x7f8254106b70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8250030460 tx=0x7f8250030710 comp rx=0 tx=0).stop 2024-09-13T05:42:32.162 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.539+0000 7f825c165640 1 -- 172.21.15.79:0/3044827655 shutdown_connections 2024-09-13T05:42:32.163 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.539+0000 7f825c165640 1 --2- 172.21.15.79:0/3044827655 >> v2:172.21.15.79:6800/784563831 conn(0x7f824003f630 0x7f8240041af0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:32.163 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.539+0000 7f825c165640 1 --2- 172.21.15.79:0/3044827655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f825407a440 0x7f8254106b70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:32.163 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.539+0000 7f825c165640 1 -- 172.21.15.79:0/3044827655 >> 172.21.15.79:0/3044827655 conn(0x7f82541011b0 msgr2=0x7f8254101ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:32.163 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.539+0000 7f825c165640 1 -- 172.21.15.79:0/3044827655 shutdown_connections 2024-09-13T05:42:32.163 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:31.539+0000 7f825c165640 1 -- 172.21.15.79:0/3044827655 wait complete. 2024-09-13T05:42:32.163 INFO:teuthology.orchestra.run.smithi079.stdout:Enabling cephadm module... 2024-09-13T05:42:34.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:33 smithi079 bash[22814]: audit 2024-09-13T05:42:33.693435+0000 mon.a (mon.0) 32 : audit [INF] from='client.? 172.21.15.79:0/1787350732' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-13T05:42:34.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:33 smithi079 bash[22814]: audit 2024-09-13T05:42:33.693435+0000 mon.a (mon.0) 32 : audit [INF] from='client.? 172.21.15.79:0/1787350732' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-13T05:42:34.236 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:33 smithi079 bash[23069]: ignoring --setuser ceph since I am not root 2024-09-13T05:42:34.236 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:33 smithi079 bash[23069]: ignoring --setgroup ceph since I am not root 2024-09-13T05:42:34.344 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.239+0000 7f4a3561e640 1 Processor -- start 2024-09-13T05:42:34.345 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.239+0000 7f4a3561e640 1 -- start start 2024-09-13T05:42:34.345 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.239+0000 7f4a3561e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a30080970 0x7f4a30080d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:34.345 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.239+0000 7f4a3561e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4a30081360 con 0x7f4a30080970 2024-09-13T05:42:34.345 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.239+0000 7f4a2effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a30080970 0x7f4a30080d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:34.345 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.239+0000 7f4a2effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a30080970 0x7f4a30080d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46790/0 (socket says 172.21.15.79:46790) 2024-09-13T05:42:34.345 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.239+0000 7f4a2effd640 1 -- 172.21.15.79:0/481266374 learned_addr learned my addr 172.21.15.79:0/481266374 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:34.345 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a2effd640 1 -- 172.21.15.79:0/481266374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a300814e0 con 0x7f4a30080970 2024-09-13T05:42:34.345 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a2effd640 1 --2- 172.21.15.79:0/481266374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a30080970 0x7f4a30080d70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009820 tx=0x7f4a1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632056cc33c528e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:34.345 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a2dffb640 1 -- 172.21.15.79:0/481266374 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a18037070 con 0x7f4a30080970 2024-09-13T05:42:34.345 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a2dffb640 1 -- 172.21.15.79:0/481266374 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f4a180328a0 con 0x7f4a30080970 2024-09-13T05:42:34.345 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a2dffb640 1 -- 172.21.15.79:0/481266374 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a18030690 con 0x7f4a30080970 2024-09-13T05:42:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a3561e640 1 -- 172.21.15.79:0/481266374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a30080970 msgr2=0x7f4a30080d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a3561e640 1 --2- 172.21.15.79:0/481266374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a30080970 0x7f4a30080d70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009820 tx=0x7f4a1802a270 comp rx=0 tx=0).stop 2024-09-13T05:42:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a3561e640 1 -- 172.21.15.79:0/481266374 shutdown_connections 2024-09-13T05:42:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a3561e640 1 --2- 172.21.15.79:0/481266374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a30080970 0x7f4a30080d70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a3561e640 1 -- 172.21.15.79:0/481266374 >> 172.21.15.79:0/481266374 conn(0x7f4a3007c200 msgr2=0x7f4a3007e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a3561e640 1 -- 172.21.15.79:0/481266374 shutdown_connections 2024-09-13T05:42:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a3561e640 1 -- 172.21.15.79:0/481266374 wait complete. 2024-09-13T05:42:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a3561e640 1 Processor -- start 2024-09-13T05:42:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a3561e640 1 -- start start 2024-09-13T05:42:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a3561e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a30080970 0x7f4a301a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a3561e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4a301113c0 con 0x7f4a30080970 2024-09-13T05:42:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a2effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a30080970 0x7f4a301a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a2effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a30080970 0x7f4a301a0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46796/0 (socket says 172.21.15.79:46796) 2024-09-13T05:42:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a2effd640 1 -- 172.21.15.79:0/1787350732 learned_addr learned my addr 172.21.15.79:0/1787350732 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:34.347 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a2effd640 1 -- 172.21.15.79:0/1787350732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a301a1490 con 0x7f4a30080970 2024-09-13T05:42:34.347 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a2effd640 1 --2- 172.21.15.79:0/1787350732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a30080970 0x7f4a301a0f30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4a18000c00 tx=0x7f4a18030bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:34.347 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a27fff640 1 -- 172.21.15.79:0/1787350732 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a18042070 con 0x7f4a30080970 2024-09-13T05:42:34.347 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a27fff640 1 -- 172.21.15.79:0/1787350732 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f4a18030e00 con 0x7f4a30080970 2024-09-13T05:42:34.347 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a27fff640 1 -- 172.21.15.79:0/1787350732 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a18037040 con 0x7f4a30080970 2024-09-13T05:42:34.347 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a3561e640 1 -- 172.21.15.79:0/1787350732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a301a1720 con 0x7f4a30080970 2024-09-13T05:42:34.347 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.243+0000 7f4a3561e640 1 -- 172.21.15.79:0/1787350732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a301a20e0 con 0x7f4a30080970 2024-09-13T05:42:34.347 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.247+0000 7f4a27fff640 1 -- 172.21.15.79:0/1787350732 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) ==== 51719+0+0 (secure 0 0 0) 0x7f4a18045070 con 0x7f4a30080970 2024-09-13T05:42:34.347 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.247+0000 7f4a3561e640 1 -- 172.21.15.79:0/1787350732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a30080df0 con 0x7f4a30080970 2024-09-13T05:42:34.347 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.247+0000 7f4a27fff640 1 --2- 172.21.15.79:0/1787350732 >> v2:172.21.15.79:6800/784563831 conn(0x7f4a1c03f6d0 0x7f4a1c041b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:34.347 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.247+0000 7f4a27fff640 1 -- 172.21.15.79:0/1787350732 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4a18073dd0 con 0x7f4a30080970 2024-09-13T05:42:34.347 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.247+0000 7f4a2e7fc640 1 --2- 172.21.15.79:0/1787350732 >> v2:172.21.15.79:6800/784563831 conn(0x7f4a1c03f6d0 0x7f4a1c041b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:34.347 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.247+0000 7f4a2e7fc640 1 --2- 172.21.15.79:0/1787350732 >> v2:172.21.15.79:6800/784563831 conn(0x7f4a1c03f6d0 0x7f4a1c041b90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4a200098c0 tx=0x7f4a20006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:34.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.251+0000 7f4a27fff640 1 -- 172.21.15.79:0/1787350732 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f4a1804b170 con 0x7f4a30080970 2024-09-13T05:42:34.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.687+0000 7f4a3561e640 1 -- 172.21.15.79:0/1787350732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f4a301a28c0 con 0x7f4a30080970 2024-09-13T05:42:34.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.739+0000 7f4a27fff640 1 -- 172.21.15.79:0/1787350732 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f4a18037e40 con 0x7f4a30080970 2024-09-13T05:42:34.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.743+0000 7f4a27fff640 1 -- 172.21.15.79:0/1787350732 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mgrmap(e 5) ==== 51730+0+0 (secure 0 0 0) 0x7f4a18031d50 con 0x7f4a30080970 2024-09-13T05:42:34.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.743+0000 7f4a3561e640 1 -- 172.21.15.79:0/1787350732 >> v2:172.21.15.79:6800/784563831 conn(0x7f4a1c03f6d0 msgr2=0x7f4a1c041b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:34.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.743+0000 7f4a3561e640 1 --2- 172.21.15.79:0/1787350732 >> v2:172.21.15.79:6800/784563831 conn(0x7f4a1c03f6d0 0x7f4a1c041b90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4a200098c0 tx=0x7f4a20006db0 comp rx=0 tx=0).stop 2024-09-13T05:42:34.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.743+0000 7f4a3561e640 1 -- 172.21.15.79:0/1787350732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a30080970 msgr2=0x7f4a301a0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:34.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.743+0000 7f4a3561e640 1 --2- 172.21.15.79:0/1787350732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a30080970 0x7f4a301a0f30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4a18000c00 tx=0x7f4a18030bc0 comp rx=0 tx=0).stop 2024-09-13T05:42:34.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.743+0000 7f4a3561e640 1 -- 172.21.15.79:0/1787350732 shutdown_connections 2024-09-13T05:42:34.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.743+0000 7f4a3561e640 1 --2- 172.21.15.79:0/1787350732 >> v2:172.21.15.79:6800/784563831 conn(0x7f4a1c03f6d0 0x7f4a1c041b90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:34.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.743+0000 7f4a3561e640 1 --2- 172.21.15.79:0/1787350732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a30080970 0x7f4a301a0f30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:34.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.743+0000 7f4a3561e640 1 -- 172.21.15.79:0/1787350732 >> 172.21.15.79:0/1787350732 conn(0x7f4a3007c200 msgr2=0x7f4a3007cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:34.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.743+0000 7f4a3561e640 1 -- 172.21.15.79:0/1787350732 shutdown_connections 2024-09-13T05:42:34.349 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:33.743+0000 7f4a3561e640 1 -- 172.21.15.79:0/1787350732 wait complete. 2024-09-13T05:42:35.214 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:34 smithi079 bash[22814]: audit 2024-09-13T05:42:33.745248+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.15.79:0/1787350732' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T05:42:35.215 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:34 smithi079 bash[22814]: audit 2024-09-13T05:42:33.745248+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.15.79:0/1787350732' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T05:42:35.215 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:34 smithi079 bash[22814]: cluster 2024-09-13T05:42:33.750619+0000 mon.a (mon.0) 34 : cluster [DBG] mgrmap e5: y(active, since 6s) 2024-09-13T05:42:35.215 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:34 smithi079 bash[22814]: cluster 2024-09-13T05:42:33.750619+0000 mon.a (mon.0) 34 : cluster [DBG] mgrmap e5: y(active, since 6s) 2024-09-13T05:42:36.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:35 smithi079 bash[22814]: audit 2024-09-13T05:42:35.827061+0000 mon.a (mon.0) 35 : audit [DBG] from='client.? 172.21.15.79:0/3895674114' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-13T05:42:36.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:35 smithi079 bash[22814]: audit 2024-09-13T05:42:35.827061+0000 mon.a (mon.0) 35 : audit [DBG] from='client.? 172.21.15.79:0/3895674114' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-13T05:42:36.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-13T05:42:36.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T05:42:36.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T05:42:36.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-13T05:42:36.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T05:42:36.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-13T05:42:36.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.378+0000 7fdb4cfdc640 1 Processor -- start 2024-09-13T05:42:36.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.378+0000 7fdb4cfdc640 1 -- start start 2024-09-13T05:42:36.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.378+0000 7fdb4cfdc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb48105860 0x7fdb48105c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:36.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.378+0000 7fdb4cfdc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdb48106250 con 0x7fdb48105860 2024-09-13T05:42:36.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.378+0000 7fdb4659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb48105860 0x7fdb48105c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:36.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.378+0000 7fdb4659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb48105860 0x7fdb48105c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46834/0 (socket says 172.21.15.79:46834) 2024-09-13T05:42:36.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.378+0000 7fdb4659c640 1 -- 172.21.15.79:0/1093377089 learned_addr learned my addr 172.21.15.79:0/1093377089 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:36.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.378+0000 7fdb4659c640 1 -- 172.21.15.79:0/1093377089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb481063d0 con 0x7fdb48105860 2024-09-13T05:42:36.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4659c640 1 --2- 172.21.15.79:0/1093377089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb48105860 0x7fdb48105c60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c009820 tx=0x7fdb3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b20a64ccc8b3fcd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:36.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4559a640 1 -- 172.21.15.79:0/1093377089 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb3c037070 con 0x7fdb48105860 2024-09-13T05:42:36.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4559a640 1 -- 172.21.15.79:0/1093377089 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fdb3c0328a0 con 0x7fdb48105860 2024-09-13T05:42:36.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4559a640 1 -- 172.21.15.79:0/1093377089 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb3c030690 con 0x7fdb48105860 2024-09-13T05:42:36.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/1093377089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb48105860 msgr2=0x7fdb48105c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:36.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4cfdc640 1 --2- 172.21.15.79:0/1093377089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb48105860 0x7fdb48105c60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c009820 tx=0x7fdb3c02a270 comp rx=0 tx=0).stop 2024-09-13T05:42:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/1093377089 shutdown_connections 2024-09-13T05:42:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4cfdc640 1 --2- 172.21.15.79:0/1093377089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb48105860 0x7fdb48105c60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/1093377089 >> 172.21.15.79:0/1093377089 conn(0x7fdb481011b0 msgr2=0x7fdb481035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/1093377089 shutdown_connections 2024-09-13T05:42:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/1093377089 wait complete. 2024-09-13T05:42:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4cfdc640 1 Processor -- start 2024-09-13T05:42:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4cfdc640 1 -- start start 2024-09-13T05:42:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4cfdc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb48105860 0x7fdb48190810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4cfdc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdb48109ce0 con 0x7fdb48105860 2024-09-13T05:42:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb48105860 0x7fdb48190810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb48105860 0x7fdb48190810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46844/0 (socket says 172.21.15.79:46844) 2024-09-13T05:42:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4659c640 1 -- 172.21.15.79:0/3895674114 learned_addr learned my addr 172.21.15.79:0/3895674114 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4659c640 1 -- 172.21.15.79:0/3895674114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb48190d70 con 0x7fdb48105860 2024-09-13T05:42:36.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4659c640 1 --2- 172.21.15.79:0/3895674114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb48105860 0x7fdb48190810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c006f10 tx=0x7fdb3c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb377fe640 1 -- 172.21.15.79:0/3895674114 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb3c037040 con 0x7fdb48105860 2024-09-13T05:42:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/3895674114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb4818f160 con 0x7fdb48105860 2024-09-13T05:42:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb377fe640 1 -- 172.21.15.79:0/3895674114 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fdb3c040070 con 0x7fdb48105860 2024-09-13T05:42:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb377fe640 1 -- 172.21.15.79:0/3895674114 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb3c03a390 con 0x7fdb48105860 2024-09-13T05:42:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.382+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/3895674114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb4818f6e0 con 0x7fdb48105860 2024-09-13T05:42:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.386+0000 7fdb377fe640 1 -- 172.21.15.79:0/3895674114 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 51730+0+0 (secure 0 0 0) 0x7fdb3c03b430 con 0x7fdb48105860 2024-09-13T05:42:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.386+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/3895674114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb48105ce0 con 0x7fdb48105860 2024-09-13T05:42:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.386+0000 7fdb377fe640 1 --2- 172.21.15.79:0/3895674114 >> v2:172.21.15.79:6800/784563831 conn(0x7fdb3003f6d0 0x7fdb30041b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.386+0000 7fdb377fe640 1 -- 172.21.15.79:0/3895674114 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdb3c073e30 con 0x7fdb48105860 2024-09-13T05:42:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.386+0000 7fdb45d9b640 1 -- 172.21.15.79:0/3895674114 >> v2:172.21.15.79:6800/784563831 conn(0x7fdb3003f6d0 msgr2=0x7fdb30041b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/784563831 2024-09-13T05:42:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.386+0000 7fdb45d9b640 1 --2- 172.21.15.79:0/3895674114 >> v2:172.21.15.79:6800/784563831 conn(0x7fdb3003f6d0 0x7fdb30041b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T05:42:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.390+0000 7fdb377fe640 1 -- 172.21.15.79:0/3895674114 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7fdb3c032830 con 0x7fdb48105860 2024-09-13T05:42:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.590+0000 7fdb45d9b640 1 -- 172.21.15.79:0/3895674114 >> v2:172.21.15.79:6800/784563831 conn(0x7fdb3003f6d0 msgr2=0x7fdb30041b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/784563831 2024-09-13T05:42:36.432 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.590+0000 7fdb45d9b640 1 --2- 172.21.15.79:0/3895674114 >> v2:172.21.15.79:6800/784563831 conn(0x7fdb3003f6d0 0x7fdb30041b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T05:42:36.432 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.822+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/3895674114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fdb4818fca0 con 0x7fdb48105860 2024-09-13T05:42:36.432 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.826+0000 7fdb377fe640 1 -- 172.21.15.79:0/3895674114 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fdb3c073b90 con 0x7fdb48105860 2024-09-13T05:42:36.432 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.826+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/3895674114 >> v2:172.21.15.79:6800/784563831 conn(0x7fdb3003f6d0 msgr2=0x7fdb30041b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T05:42:36.432 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.826+0000 7fdb4cfdc640 1 --2- 172.21.15.79:0/3895674114 >> v2:172.21.15.79:6800/784563831 conn(0x7fdb3003f6d0 0x7fdb30041b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:36.432 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.826+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/3895674114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb48105860 msgr2=0x7fdb48190810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:36.432 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.826+0000 7fdb4cfdc640 1 --2- 172.21.15.79:0/3895674114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb48105860 0x7fdb48190810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c006f10 tx=0x7fdb3c032670 comp rx=0 tx=0).stop 2024-09-13T05:42:36.432 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.826+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/3895674114 shutdown_connections 2024-09-13T05:42:36.432 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.826+0000 7fdb4cfdc640 1 --2- 172.21.15.79:0/3895674114 >> v2:172.21.15.79:6800/784563831 conn(0x7fdb3003f6d0 0x7fdb30041b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:36.432 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.826+0000 7fdb4cfdc640 1 --2- 172.21.15.79:0/3895674114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb48105860 0x7fdb48190810 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:36.432 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.826+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/3895674114 >> 172.21.15.79:0/3895674114 conn(0x7fdb481011b0 msgr2=0x7fdb48079820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:36.432 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.826+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/3895674114 shutdown_connections 2024-09-13T05:42:36.433 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:35.826+0000 7fdb4cfdc640 1 -- 172.21.15.79:0/3895674114 wait complete. 2024-09-13T05:42:36.433 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for the mgr to restart... 2024-09-13T05:42:36.433 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr epoch 5... 2024-09-13T05:42:40.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: cluster 2024-09-13T05:42:39.724087+0000 mon.a (mon.0) 36 : cluster [INF] Active manager daemon y restarted 2024-09-13T05:42:40.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: cluster 2024-09-13T05:42:39.724087+0000 mon.a (mon.0) 36 : cluster [INF] Active manager daemon y restarted 2024-09-13T05:42:40.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: cluster 2024-09-13T05:42:39.724547+0000 mon.a (mon.0) 37 : cluster [INF] Activating manager daemon y 2024-09-13T05:42:40.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: cluster 2024-09-13T05:42:39.724547+0000 mon.a (mon.0) 37 : cluster [INF] Activating manager daemon y 2024-09-13T05:42:40.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: cluster 2024-09-13T05:42:39.732221+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-09-13T05:42:40.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: cluster 2024-09-13T05:42:39.732221+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-09-13T05:42:40.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: cluster 2024-09-13T05:42:39.732458+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e6: y(active, starting, since 0.00809832s) 2024-09-13T05:42:40.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: cluster 2024-09-13T05:42:39.732458+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e6: y(active, starting, since 0.00809832s) 2024-09-13T05:42:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: audit 2024-09-13T05:42:39.734329+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:42:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: audit 2024-09-13T05:42:39.734329+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:42:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: audit 2024-09-13T05:42:39.735589+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-13T05:42:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: audit 2024-09-13T05:42:39.735589+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-13T05:42:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: audit 2024-09-13T05:42:39.737186+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-13T05:42:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: audit 2024-09-13T05:42:39.737186+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-13T05:42:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: audit 2024-09-13T05:42:39.737364+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-13T05:42:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: audit 2024-09-13T05:42:39.737364+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-13T05:42:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: audit 2024-09-13T05:42:39.737534+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-13T05:42:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: audit 2024-09-13T05:42:39.737534+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-13T05:42:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: cluster 2024-09-13T05:42:39.761519+0000 mon.a (mon.0) 45 : cluster [INF] Manager daemon y is now available 2024-09-13T05:42:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:39 smithi079 bash[22814]: cluster 2024-09-13T05:42:39.761519+0000 mon.a (mon.0) 45 : cluster [INF] Manager daemon y is now available 2024-09-13T05:42:41.379 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-13T05:42:41.379 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T05:42:41.379 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T05:42:41.379 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-13T05:42:41.379 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.498+0000 7efee1468640 1 Processor -- start 2024-09-13T05:42:41.379 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.498+0000 7efee1468640 1 -- start start 2024-09-13T05:42:41.379 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.498+0000 7efee1468640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc107f80 0x7efedc108380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:41.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.498+0000 7efee1468640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efedc1088c0 con 0x7efedc107f80 2024-09-13T05:42:41.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.498+0000 7efedaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc107f80 0x7efedc108380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:41.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.498+0000 7efedaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc107f80 0x7efedc108380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46850/0 (socket says 172.21.15.79:46850) 2024-09-13T05:42:41.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.498+0000 7efedaffd640 1 -- 172.21.15.79:0/2132740903 learned_addr learned my addr 172.21.15.79:0/2132740903 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:41.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.498+0000 7efedaffd640 1 -- 172.21.15.79:0/2132740903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc108a40 con 0x7efedc107f80 2024-09-13T05:42:41.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.498+0000 7efedaffd640 1 --2- 172.21.15.79:0/2132740903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc107f80 0x7efedc108380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efecc009820 tx=0x7efecc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c346e076375c9ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:41.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.498+0000 7efeda7fc640 1 -- 172.21.15.79:0/2132740903 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efecc037070 con 0x7efedc107f80 2024-09-13T05:42:41.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.498+0000 7efeda7fc640 1 -- 172.21.15.79:0/2132740903 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7efecc0328a0 con 0x7efedc107f80 2024-09-13T05:42:41.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.498+0000 7efeda7fc640 1 -- 172.21.15.79:0/2132740903 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efecc030690 con 0x7efedc107f80 2024-09-13T05:42:41.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efee1468640 1 -- 172.21.15.79:0/2132740903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc107f80 msgr2=0x7efedc108380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efee1468640 1 --2- 172.21.15.79:0/2132740903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc107f80 0x7efedc108380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efecc009820 tx=0x7efecc02a270 comp rx=0 tx=0).stop 2024-09-13T05:42:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efee1468640 1 -- 172.21.15.79:0/2132740903 shutdown_connections 2024-09-13T05:42:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efee1468640 1 --2- 172.21.15.79:0/2132740903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc107f80 0x7efedc108380 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efee1468640 1 -- 172.21.15.79:0/2132740903 >> 172.21.15.79:0/2132740903 conn(0x7efedc100930 msgr2=0x7efedc102d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efee1468640 1 -- 172.21.15.79:0/2132740903 shutdown_connections 2024-09-13T05:42:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efee1468640 1 -- 172.21.15.79:0/2132740903 wait complete. 2024-09-13T05:42:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efee1468640 1 Processor -- start 2024-09-13T05:42:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efee1468640 1 -- start start 2024-09-13T05:42:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efee1468640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc107f80 0x7efedc107380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efee1468640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efedc105760 con 0x7efedc107f80 2024-09-13T05:42:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efedaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc107f80 0x7efedc107380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efedaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc107f80 0x7efedc107380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46864/0 (socket says 172.21.15.79:46864) 2024-09-13T05:42:41.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efedaffd640 1 -- 172.21.15.79:0/1366248811 learned_addr learned my addr 172.21.15.79:0/1366248811 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:41.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efedaffd640 1 -- 172.21.15.79:0/1366248811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc1078e0 con 0x7efedc107f80 2024-09-13T05:42:41.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efedaffd640 1 --2- 172.21.15.79:0/1366248811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc107f80 0x7efedc107380 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efecc000c00 tx=0x7efecc030bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:41.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efed8ff9640 1 -- 172.21.15.79:0/1366248811 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efecc042070 con 0x7efedc107f80 2024-09-13T05:42:41.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efed8ff9640 1 -- 172.21.15.79:0/1366248811 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7efecc030e00 con 0x7efedc107f80 2024-09-13T05:42:41.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efee1468640 1 -- 172.21.15.79:0/1366248811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efedc105cd0 con 0x7efedc107f80 2024-09-13T05:42:41.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efed8ff9640 1 -- 172.21.15.79:0/1366248811 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efecc037040 con 0x7efedc107f80 2024-09-13T05:42:41.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efee1468640 1 -- 172.21.15.79:0/1366248811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efedc106250 con 0x7efedc107f80 2024-09-13T05:42:41.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efed8ff9640 1 -- 172.21.15.79:0/1366248811 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 51730+0+0 (secure 0 0 0) 0x7efecc045070 con 0x7efedc107f80 2024-09-13T05:42:41.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efed8ff9640 1 --2- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/784563831 conn(0x7efec803f720 0x7efec8041be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:41.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efed8ff9640 1 -- 172.21.15.79:0/1366248811 --> v2:172.21.15.79:6800/784563831 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efec80422b0 con 0x7efec803f720 2024-09-13T05:42:41.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efed8ff9640 1 -- 172.21.15.79:0/1366248811 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efecc073ed0 con 0x7efedc107f80 2024-09-13T05:42:41.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efed27fc640 1 -- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/784563831 conn(0x7efec803f720 msgr2=0x7efec8041be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/784563831 2024-09-13T05:42:41.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.502+0000 7efed27fc640 1 --2- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/784563831 conn(0x7efec803f720 0x7efec8041be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T05:42:41.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.706+0000 7efed27fc640 1 -- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/784563831 conn(0x7efec803f720 msgr2=0x7efec8041be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/784563831 2024-09-13T05:42:41.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:37.706+0000 7efed27fc640 1 --2- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/784563831 conn(0x7efec803f720 0x7efec8041be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T05:42:41.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:38.110+0000 7efed27fc640 1 -- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/784563831 conn(0x7efec803f720 msgr2=0x7efec8041be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/784563831 2024-09-13T05:42:41.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:38.110+0000 7efed27fc640 1 --2- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/784563831 conn(0x7efec803f720 0x7efec8041be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T05:42:41.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:38.914+0000 7efed27fc640 1 -- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/784563831 conn(0x7efec803f720 msgr2=0x7efec8041be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/784563831 2024-09-13T05:42:41.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:38.914+0000 7efed27fc640 1 --2- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/784563831 conn(0x7efec803f720 0x7efec8041be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T05:42:41.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:39.726+0000 7efed8ff9640 1 -- 172.21.15.79:0/1366248811 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mgrmap(e 6) ==== 51532+0+0 (secure 0 0 0) 0x7efecc072990 con 0x7efedc107f80 2024-09-13T05:42:41.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:39.726+0000 7efed8ff9640 1 -- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/784563831 conn(0x7efec803f720 msgr2=0x7efec8041be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T05:42:41.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:39.726+0000 7efed8ff9640 1 --2- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/784563831 conn(0x7efec803f720 0x7efec8041be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:41.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.730+0000 7efed8ff9640 1 -- 172.21.15.79:0/1366248811 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 7) ==== 51624+0+0 (secure 0 0 0) 0x7efecc043d20 con 0x7efedc107f80 2024-09-13T05:42:41.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.730+0000 7efed8ff9640 1 --2- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/3535502969 conn(0x7efec8042ff0 0x7efec80453e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:41.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.730+0000 7efed8ff9640 1 -- 172.21.15.79:0/1366248811 --> v2:172.21.15.79:6800/3535502969 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efecc006810 con 0x7efec8042ff0 2024-09-13T05:42:41.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.734+0000 7efed27fc640 1 --2- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/3535502969 conn(0x7efec8042ff0 0x7efec80453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:41.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.734+0000 7efed27fc640 1 --2- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/3535502969 conn(0x7efec8042ff0 0x7efec80453e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efec4003980 tx=0x7efec40092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:41.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.734+0000 7efed8ff9640 1 -- 172.21.15.79:0/1366248811 <== mgr.14118 v2:172.21.15.79:6800/3535502969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7efecc006810 con 0x7efec8042ff0 2024-09-13T05:42:41.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.750+0000 7efee1468640 1 -- 172.21.15.79:0/1366248811 --> v2:172.21.15.79:6800/3535502969 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7efedc107b70 con 0x7efec8042ff0 2024-09-13T05:42:41.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.750+0000 7efed8ff9640 1 -- 172.21.15.79:0/1366248811 <== mgr.14118 v2:172.21.15.79:6800/3535502969 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7efedc107b70 con 0x7efec8042ff0 2024-09-13T05:42:41.385 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.750+0000 7efee1468640 1 -- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/3535502969 conn(0x7efec8042ff0 msgr2=0x7efec80453e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:41.385 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.750+0000 7efee1468640 1 --2- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/3535502969 conn(0x7efec8042ff0 0x7efec80453e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efec4003980 tx=0x7efec40092b0 comp rx=0 tx=0).stop 2024-09-13T05:42:41.385 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.750+0000 7efee1468640 1 -- 172.21.15.79:0/1366248811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc107f80 msgr2=0x7efedc107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:41.385 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.750+0000 7efee1468640 1 --2- 172.21.15.79:0/1366248811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc107f80 0x7efedc107380 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efecc000c00 tx=0x7efecc030bc0 comp rx=0 tx=0).stop 2024-09-13T05:42:41.385 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.750+0000 7efee1468640 1 -- 172.21.15.79:0/1366248811 shutdown_connections 2024-09-13T05:42:41.385 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.750+0000 7efee1468640 1 --2- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/3535502969 conn(0x7efec8042ff0 0x7efec80453e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:41.385 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.750+0000 7efee1468640 1 --2- 172.21.15.79:0/1366248811 >> v2:172.21.15.79:6800/784563831 conn(0x7efec803f720 0x7efec8041be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:41.385 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.750+0000 7efee1468640 1 --2- 172.21.15.79:0/1366248811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efedc107f80 0x7efedc107380 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:41.385 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.750+0000 7efee1468640 1 -- 172.21.15.79:0/1366248811 >> 172.21.15.79:0/1366248811 conn(0x7efedc100930 msgr2=0x7efedc101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:41.385 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.750+0000 7efee1468640 1 -- 172.21.15.79:0/1366248811 shutdown_connections 2024-09-13T05:42:41.385 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:40.750+0000 7efee1468640 1 -- 172.21.15.79:0/1366248811 wait complete. 2024-09-13T05:42:41.386 INFO:teuthology.orchestra.run.smithi079.stdout:mgr epoch 5 is available 2024-09-13T05:42:41.386 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying orchestrator module is enabled... 2024-09-13T05:42:41.719 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.396065+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:41.719 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.396065+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:41.719 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.398644+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:41.719 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.398644+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:41.719 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: cephadm 2024-09-13T05:42:40.399310+0000 mgr.y (mgr.14118) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-09-13T05:42:41.719 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: cephadm 2024-09-13T05:42:40.399310+0000 mgr.y (mgr.14118) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-09-13T05:42:41.719 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.400932+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:41.720 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.400932+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:41.720 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.403878+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:41.720 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.403878+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:41.720 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.406963+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:42:41.720 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.406963+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:42:41.720 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.409674+0000 mon.a (mon.0) 51 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:42:41.720 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.409674+0000 mon.a (mon.0) 51 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:42:41.720 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.420196+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-13T05:42:41.720 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.420196+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-13T05:42:41.720 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.422431+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-13T05:42:41.720 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.422431+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-13T05:42:41.720 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.737625+0000 mgr.y (mgr.14118) 2 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T05:42:41.720 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.737625+0000 mgr.y (mgr.14118) 2 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T05:42:41.720 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: cluster 2024-09-13T05:42:40.739599+0000 mon.a (mon.0) 54 : cluster [DBG] mgrmap e7: y(active, since 1.01523s) 2024-09-13T05:42:41.721 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: cluster 2024-09-13T05:42:40.739599+0000 mon.a (mon.0) 54 : cluster [DBG] mgrmap e7: y(active, since 1.01523s) 2024-09-13T05:42:41.721 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.751439+0000 mgr.y (mgr.14118) 3 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T05:42:41.721 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[22814]: audit 2024-09-13T05:42:40.751439+0000 mgr.y (mgr.14118) 3 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T05:42:41.987 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: debug 2024-09-13T05:42:41.718+0000 7fec272a4640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:05:42:41] ENGINE Error in HTTPServer.serve 2024-09-13T05:42:41.987 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: Traceback (most recent call last): 2024-09-13T05:42:41.987 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T05:42:41.987 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: self._connections.run(self.expiration_interval) 2024-09-13T05:42:41.987 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T05:42:41.987 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: self._run(expiration_interval) 2024-09-13T05:42:41.987 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T05:42:41.987 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T05:42:41.987 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T05:42:41.988 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T05:42:41.988 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T05:42:41.988 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: s = self.context.wrap_socket( 2024-09-13T05:42:41.988 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T05:42:41.988 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: return self.sslsocket_class._create( 2024-09-13T05:42:41.988 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T05:42:41.988 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: self.do_handshake() 2024-09-13T05:42:41.988 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T05:42:41.988 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: self._sslobj.do_handshake() 2024-09-13T05:42:41.988 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:41 smithi079 bash[23069]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T05:42:42.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: cephadm 2024-09-13T05:42:41.496329+0000 mgr.y (mgr.14118) 4 : cephadm [INF] [13/Sep/2024:05:42:41] ENGINE Bus STARTING 2024-09-13T05:42:42.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: cephadm 2024-09-13T05:42:41.496329+0000 mgr.y (mgr.14118) 4 : cephadm [INF] [13/Sep/2024:05:42:41] ENGINE Bus STARTING 2024-09-13T05:42:42.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: cephadm 2024-09-13T05:42:41.598197+0000 mgr.y (mgr.14118) 5 : cephadm [INF] [13/Sep/2024:05:42:41] ENGINE Serving on http://172.21.15.79:8765 2024-09-13T05:42:42.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: cephadm 2024-09-13T05:42:41.598197+0000 mgr.y (mgr.14118) 5 : cephadm [INF] [13/Sep/2024:05:42:41] ENGINE Serving on http://172.21.15.79:8765 2024-09-13T05:42:42.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: cephadm 2024-09-13T05:42:41.718529+0000 mgr.y (mgr.14118) 6 : cephadm [INF] [13/Sep/2024:05:42:41] ENGINE Serving on https://172.21.15.79:7150 2024-09-13T05:42:42.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: cephadm 2024-09-13T05:42:41.718529+0000 mgr.y (mgr.14118) 6 : cephadm [INF] [13/Sep/2024:05:42:41] ENGINE Serving on https://172.21.15.79:7150 2024-09-13T05:42:42.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: cephadm 2024-09-13T05:42:41.718677+0000 mgr.y (mgr.14118) 7 : cephadm [INF] [13/Sep/2024:05:42:41] ENGINE Bus STARTED 2024-09-13T05:42:42.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: cephadm 2024-09-13T05:42:41.718677+0000 mgr.y (mgr.14118) 7 : cephadm [INF] [13/Sep/2024:05:42:41] ENGINE Bus STARTED 2024-09-13T05:42:42.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: audit 2024-09-13T05:42:41.719678+0000 mon.a (mon.0) 55 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:42:42.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: audit 2024-09-13T05:42:41.719678+0000 mon.a (mon.0) 55 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:42:42.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: cephadm 2024-09-13T05:42:41.720722+0000 mgr.y (mgr.14118) 8 : cephadm [ERR] [13/Sep/2024:05:42:41] ENGINE Error in HTTPServer.serve 2024-09-13T05:42:42.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: Traceback (most recent call last): 2024-09-13T05:42:42.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T05:42:42.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: self._connections.run(self.expiration_interval) 2024-09-13T05:42:42.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T05:42:42.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: self._run(expiration_interval) 2024-09-13T05:42:42.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T05:42:42.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T05:42:42.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T05:42:42.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T05:42:42.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T05:42:42.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: s = self.context.wrap_socket( 2024-09-13T05:42:42.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T05:42:42.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: return self.sslsocket_class._create( 2024-09-13T05:42:42.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T05:42:42.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: self.do_handshake() 2024-09-13T05:42:42.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T05:42:42.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: self._sslobj.do_handshake() 2024-09-13T05:42:42.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T05:42:42.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: cephadm 2024-09-13T05:42:41.720722+0000 mgr.y (mgr.14118) 8 : cephadm [ERR] [13/Sep/2024:05:42:41] ENGINE Error in HTTPServer.serve 2024-09-13T05:42:42.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: Traceback (most recent call last): 2024-09-13T05:42:42.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T05:42:42.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: self._connections.run(self.expiration_interval) 2024-09-13T05:42:42.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T05:42:42.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: self._run(expiration_interval) 2024-09-13T05:42:42.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T05:42:42.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T05:42:42.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T05:42:42.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T05:42:42.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T05:42:42.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: s = self.context.wrap_socket( 2024-09-13T05:42:42.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T05:42:42.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: return self.sslsocket_class._create( 2024-09-13T05:42:42.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T05:42:42.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: self.do_handshake() 2024-09-13T05:42:42.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T05:42:42.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: self._sslobj.do_handshake() 2024-09-13T05:42:42.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:42 smithi079 bash[22814]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T05:42:43.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:43 smithi079 bash[22814]: cluster 2024-09-13T05:42:42.402089+0000 mon.a (mon.0) 56 : cluster [DBG] mgrmap e8: y(active, since 2s) 2024-09-13T05:42:43.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:43 smithi079 bash[22814]: cluster 2024-09-13T05:42:42.402089+0000 mon.a (mon.0) 56 : cluster [DBG] mgrmap e8: y(active, since 2s) 2024-09-13T05:42:43.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:43 smithi079 bash[22814]: audit 2024-09-13T05:42:43.116095+0000 mon.a (mon.0) 57 : audit [INF] from='client.? 172.21.15.79:0/1497465530' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-13T05:42:43.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:43 smithi079 bash[22814]: audit 2024-09-13T05:42:43.116095+0000 mon.a (mon.0) 57 : audit [INF] from='client.? 172.21.15.79:0/1497465530' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-13T05:42:44.003 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.654+0000 7fbad2a11640 1 Processor -- start 2024-09-13T05:42:44.003 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.654+0000 7fbad2a11640 1 -- start start 2024-09-13T05:42:44.004 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.654+0000 7fbad2a11640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbacc108b40 0x7fbacc108f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:44.004 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.654+0000 7fbad2a11640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc109530 con 0x7fbacc108b40 2024-09-13T05:42:44.004 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.654+0000 7fbacbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbacc108b40 0x7fbacc108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:44.004 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.654+0000 7fbacbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbacc108b40 0x7fbacc108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46950/0 (socket says 172.21.15.79:46950) 2024-09-13T05:42:44.004 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.654+0000 7fbacbfff640 1 -- 172.21.15.79:0/3160258207 learned_addr learned my addr 172.21.15.79:0/3160258207 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:44.004 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.654+0000 7fbacbfff640 1 -- 172.21.15.79:0/3160258207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbacc1096b0 con 0x7fbacc108b40 2024-09-13T05:42:44.004 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbacbfff640 1 --2- 172.21.15.79:0/3160258207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbacc108b40 0x7fbacc108f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009820 tx=0x7fbab402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4cee5b8c392b69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:44.005 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbacaffd640 1 -- 172.21.15.79:0/3160258207 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbab4037070 con 0x7fbacc108b40 2024-09-13T05:42:44.005 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbacaffd640 1 -- 172.21.15.79:0/3160258207 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fbab40328a0 con 0x7fbacc108b40 2024-09-13T05:42:44.005 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbacaffd640 1 -- 172.21.15.79:0/3160258207 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbab4030690 con 0x7fbacc108b40 2024-09-13T05:42:44.005 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbad2a11640 1 -- 172.21.15.79:0/3160258207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbacc108b40 msgr2=0x7fbacc108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:44.005 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbad2a11640 1 --2- 172.21.15.79:0/3160258207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbacc108b40 0x7fbacc108f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009820 tx=0x7fbab402a270 comp rx=0 tx=0).stop 2024-09-13T05:42:44.005 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbad2a11640 1 -- 172.21.15.79:0/3160258207 shutdown_connections 2024-09-13T05:42:44.005 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbad2a11640 1 --2- 172.21.15.79:0/3160258207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbacc108b40 0x7fbacc108f40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:44.005 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbad2a11640 1 -- 172.21.15.79:0/3160258207 >> 172.21.15.79:0/3160258207 conn(0x7fbacc07c350 msgr2=0x7fbacc07c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:44.006 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbad2a11640 1 -- 172.21.15.79:0/3160258207 shutdown_connections 2024-09-13T05:42:44.006 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbad2a11640 1 -- 172.21.15.79:0/3160258207 wait complete. 2024-09-13T05:42:44.006 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbad2a11640 1 Processor -- start 2024-09-13T05:42:44.006 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbad2a11640 1 -- start start 2024-09-13T05:42:44.006 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbad2a11640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbacc108b40 0x7fbacc19caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:44.006 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbad2a11640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc10cfc0 con 0x7fbacc108b40 2024-09-13T05:42:44.006 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbacbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbacc108b40 0x7fbacc19caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:44.006 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbacbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbacc108b40 0x7fbacc19caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46956/0 (socket says 172.21.15.79:46956) 2024-09-13T05:42:44.007 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbacbfff640 1 -- 172.21.15.79:0/1497465530 learned_addr learned my addr 172.21.15.79:0/1497465530 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:44.007 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbacbfff640 1 -- 172.21.15.79:0/1497465530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbacc19d000 con 0x7fbacc108b40 2024-09-13T05:42:44.007 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbacbfff640 1 --2- 172.21.15.79:0/1497465530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbacc108b40 0x7fbacc19caa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbab4000c00 tx=0x7fbab4032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:44.007 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbac97fa640 1 -- 172.21.15.79:0/1497465530 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbab4037040 con 0x7fbacc108b40 2024-09-13T05:42:44.007 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbac97fa640 1 -- 172.21.15.79:0/1497465530 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7fbab4040070 con 0x7fbacc108b40 2024-09-13T05:42:44.007 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbac97fa640 1 -- 172.21.15.79:0/1497465530 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbab403be40 con 0x7fbacc108b40 2024-09-13T05:42:44.007 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.658+0000 7fbad2a11640 1 -- 172.21.15.79:0/1497465530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbacc19d290 con 0x7fbacc108b40 2024-09-13T05:42:44.008 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.662+0000 7fbad2a11640 1 -- 172.21.15.79:0/1497465530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbacc19dc50 con 0x7fbacc108b40 2024-09-13T05:42:44.008 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.662+0000 7fbac97fa640 1 -- 172.21.15.79:0/1497465530 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) ==== 51730+0+0 (secure 0 0 0) 0x7fbab403b680 con 0x7fbacc108b40 2024-09-13T05:42:44.008 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.662+0000 7fbad2a11640 1 -- 172.21.15.79:0/1497465530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbacc108fc0 con 0x7fbacc108b40 2024-09-13T05:42:44.008 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.662+0000 7fbac97fa640 1 --2- 172.21.15.79:0/1497465530 >> v2:172.21.15.79:6800/3535502969 conn(0x7fbab803f720 0x7fbab8041be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:44.008 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.662+0000 7fbac97fa640 1 -- 172.21.15.79:0/1497465530 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fbab40739e0 con 0x7fbacc108b40 2024-09-13T05:42:44.008 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.662+0000 7fbacb7fe640 1 --2- 172.21.15.79:0/1497465530 >> v2:172.21.15.79:6800/3535502969 conn(0x7fbab803f720 0x7fbab8041be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:44.008 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.662+0000 7fbacb7fe640 1 --2- 172.21.15.79:0/1497465530 >> v2:172.21.15.79:6800/3535502969 conn(0x7fbab803f720 0x7fbab8041be0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0098c0 tx=0x7fbabc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:44.008 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:42.666+0000 7fbac97fa640 1 -- 172.21.15.79:0/1497465530 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7fbab4049020 con 0x7fbacc108b40 2024-09-13T05:42:44.009 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:43.114+0000 7fbad2a11640 1 -- 172.21.15.79:0/1497465530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "orchestrator"} v 0) -- 0x7fbacc19e380 con 0x7fbacc108b40 2024-09-13T05:42:44.009 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:43.406+0000 7fbac97fa640 1 -- 172.21.15.79:0/1497465530 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "orchestrator"}]=0 module 'orchestrator' is already enabled (always-on) v9) ==== 143+0+0 (secure 0 0 0) 0x7fbab403b430 con 0x7fbacc108b40 2024-09-13T05:42:44.009 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-13T05:42:44.009 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:43.410+0000 7fbac97fa640 1 -- 172.21.15.79:0/1497465530 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mgrmap(e 9) ==== 51730+0+0 (secure 0 0 0) 0x7fbab4044410 con 0x7fbacc108b40 2024-09-13T05:42:44.009 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:43.410+0000 7fbad2a11640 1 -- 172.21.15.79:0/1497465530 >> v2:172.21.15.79:6800/3535502969 conn(0x7fbab803f720 msgr2=0x7fbab8041be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:44.009 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:43.410+0000 7fbad2a11640 1 --2- 172.21.15.79:0/1497465530 >> v2:172.21.15.79:6800/3535502969 conn(0x7fbab803f720 0x7fbab8041be0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0098c0 tx=0x7fbabc006db0 comp rx=0 tx=0).stop 2024-09-13T05:42:44.009 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:43.410+0000 7fbad2a11640 1 -- 172.21.15.79:0/1497465530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbacc108b40 msgr2=0x7fbacc19caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:44.009 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:43.410+0000 7fbad2a11640 1 --2- 172.21.15.79:0/1497465530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbacc108b40 0x7fbacc19caa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbab4000c00 tx=0x7fbab4032740 comp rx=0 tx=0).stop 2024-09-13T05:42:44.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:43.410+0000 7fbad2a11640 1 -- 172.21.15.79:0/1497465530 shutdown_connections 2024-09-13T05:42:44.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:43.410+0000 7fbad2a11640 1 --2- 172.21.15.79:0/1497465530 >> v2:172.21.15.79:6800/3535502969 conn(0x7fbab803f720 0x7fbab8041be0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:44.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:43.410+0000 7fbad2a11640 1 --2- 172.21.15.79:0/1497465530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbacc108b40 0x7fbacc19caa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:44.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:43.410+0000 7fbad2a11640 1 -- 172.21.15.79:0/1497465530 >> 172.21.15.79:0/1497465530 conn(0x7fbacc07c350 msgr2=0x7fbacc1066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:44.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:43.410+0000 7fbad2a11640 1 -- 172.21.15.79:0/1497465530 shutdown_connections 2024-09-13T05:42:44.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:43.410+0000 7fbad2a11640 1 -- 172.21.15.79:0/1497465530 wait complete. 2024-09-13T05:42:44.010 INFO:teuthology.orchestra.run.smithi079.stdout:Setting orchestrator backend to cephadm... 2024-09-13T05:42:44.736 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:44 smithi079 bash[22814]: audit 2024-09-13T05:42:43.409843+0000 mon.a (mon.0) 58 : audit [INF] from='client.? 172.21.15.79:0/1497465530' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-13T05:42:44.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:44 smithi079 bash[22814]: audit 2024-09-13T05:42:43.409843+0000 mon.a (mon.0) 58 : audit [INF] from='client.? 172.21.15.79:0/1497465530' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-13T05:42:44.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:44 smithi079 bash[22814]: cluster 2024-09-13T05:42:43.415323+0000 mon.a (mon.0) 59 : cluster [DBG] mgrmap e9: y(active, since 3s) 2024-09-13T05:42:44.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:44 smithi079 bash[22814]: cluster 2024-09-13T05:42:43.415323+0000 mon.a (mon.0) 59 : cluster [DBG] mgrmap e9: y(active, since 3s) 2024-09-13T05:42:45.991 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.026+0000 7ff7f52c1640 1 Processor -- start 2024-09-13T05:42:45.991 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.026+0000 7ff7f52c1640 1 -- start start 2024-09-13T05:42:45.991 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.026+0000 7ff7f52c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f0106960 0x7ff7f0106d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:45.991 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.026+0000 7ff7f52c1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f0107350 con 0x7ff7f0106960 2024-09-13T05:42:45.992 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.026+0000 7ff7eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f0106960 0x7ff7f0106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:45.992 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.026+0000 7ff7eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f0106960 0x7ff7f0106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50500/0 (socket says 172.21.15.79:50500) 2024-09-13T05:42:45.992 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.026+0000 7ff7eeffd640 1 -- 172.21.15.79:0/940746987 learned_addr learned my addr 172.21.15.79:0/940746987 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:45.992 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.026+0000 7ff7eeffd640 1 -- 172.21.15.79:0/940746987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f01074d0 con 0x7ff7f0106960 2024-09-13T05:42:45.992 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.026+0000 7ff7eeffd640 1 --2- 172.21.15.79:0/940746987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f0106960 0x7ff7f0106d60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009820 tx=0x7ff7e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91138c4570707cf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:45.992 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.026+0000 7ff7edffb640 1 -- 172.21.15.79:0/940746987 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7e0037070 con 0x7ff7f0106960 2024-09-13T05:42:45.992 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.026+0000 7ff7edffb640 1 -- 172.21.15.79:0/940746987 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7ff7e00328a0 con 0x7ff7f0106960 2024-09-13T05:42:45.992 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.026+0000 7ff7edffb640 1 -- 172.21.15.79:0/940746987 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7e0030690 con 0x7ff7f0106960 2024-09-13T05:42:45.992 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7f52c1640 1 -- 172.21.15.79:0/940746987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f0106960 msgr2=0x7ff7f0106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:45.992 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7f52c1640 1 --2- 172.21.15.79:0/940746987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f0106960 0x7ff7f0106d60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009820 tx=0x7ff7e002a270 comp rx=0 tx=0).stop 2024-09-13T05:42:45.992 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7f52c1640 1 -- 172.21.15.79:0/940746987 shutdown_connections 2024-09-13T05:42:45.992 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7f52c1640 1 --2- 172.21.15.79:0/940746987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f0106960 0x7ff7f0106d60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:45.992 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7f52c1640 1 -- 172.21.15.79:0/940746987 >> 172.21.15.79:0/940746987 conn(0x7ff7f0102230 msgr2=0x7ff7f0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:45.993 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7f52c1640 1 -- 172.21.15.79:0/940746987 shutdown_connections 2024-09-13T05:42:45.993 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7f52c1640 1 -- 172.21.15.79:0/940746987 wait complete. 2024-09-13T05:42:45.993 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7f52c1640 1 Processor -- start 2024-09-13T05:42:45.993 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7f52c1640 1 -- start start 2024-09-13T05:42:45.993 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7f52c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f0106960 0x7ff7f019cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:45.993 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7f52c1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f007b120 con 0x7ff7f0106960 2024-09-13T05:42:45.993 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f0106960 0x7ff7f019cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:45.993 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f0106960 0x7ff7f019cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50508/0 (socket says 172.21.15.79:50508) 2024-09-13T05:42:45.993 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7eeffd640 1 -- 172.21.15.79:0/649135767 learned_addr learned my addr 172.21.15.79:0/649135767 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:45.993 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7eeffd640 1 -- 172.21.15.79:0/649135767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f019d010 con 0x7ff7f0106960 2024-09-13T05:42:45.993 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7eeffd640 1 --2- 172.21.15.79:0/649135767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f0106960 0x7ff7f019cab0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0000c00 tx=0x7ff7e0032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:45.993 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7d7fff640 1 -- 172.21.15.79:0/649135767 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7e0037040 con 0x7ff7f0106960 2024-09-13T05:42:45.993 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7d7fff640 1 -- 172.21.15.79:0/649135767 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7ff7e0040070 con 0x7ff7f0106960 2024-09-13T05:42:45.994 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7f52c1640 1 -- 172.21.15.79:0/649135767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f019d2a0 con 0x7ff7f0106960 2024-09-13T05:42:45.994 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7f52c1640 1 -- 172.21.15.79:0/649135767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f019dc60 con 0x7ff7f0106960 2024-09-13T05:42:45.994 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7d7fff640 1 -- 172.21.15.79:0/649135767 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7e003be40 con 0x7ff7f0106960 2024-09-13T05:42:45.994 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7d7fff640 1 -- 172.21.15.79:0/649135767 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 9) ==== 51730+0+0 (secure 0 0 0) 0x7ff7e0045460 con 0x7ff7f0106960 2024-09-13T05:42:45.994 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7f52c1640 1 -- 172.21.15.79:0/649135767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f0106d60 con 0x7ff7f0106960 2024-09-13T05:42:45.994 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7d7fff640 1 --2- 172.21.15.79:0/649135767 >> v2:172.21.15.79:6800/3535502969 conn(0x7ff7d803f720 0x7ff7d8041be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:45.994 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7d7fff640 1 -- 172.21.15.79:0/649135767 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7ff7e0073c30 con 0x7ff7f0106960 2024-09-13T05:42:45.994 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.030+0000 7ff7ee7fc640 1 --2- 172.21.15.79:0/649135767 >> v2:172.21.15.79:6800/3535502969 conn(0x7ff7d803f720 0x7ff7d8041be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:45.994 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.034+0000 7ff7ee7fc640 1 --2- 172.21.15.79:0/649135767 >> v2:172.21.15.79:6800/3535502969 conn(0x7ff7d803f720 0x7ff7d8041be0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40098c0 tx=0x7ff7e4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:45.994 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.038+0000 7ff7d7fff640 1 -- 172.21.15.79:0/649135767 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7ff7e003b430 con 0x7ff7f0106960 2024-09-13T05:42:45.994 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.410+0000 7ff7f52c1640 1 -- 172.21.15.79:0/649135767 --> v2:172.21.15.79:6800/3535502969 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7ff7f010a020 con 0x7ff7d803f720 2024-09-13T05:42:45.994 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.418+0000 7ff7d7fff640 1 -- 172.21.15.79:0/649135767 <== mgr.14118 v2:172.21.15.79:6800/3535502969 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff7f010a020 con 0x7ff7d803f720 2024-09-13T05:42:45.994 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.422+0000 7ff7f52c1640 1 -- 172.21.15.79:0/649135767 >> v2:172.21.15.79:6800/3535502969 conn(0x7ff7d803f720 msgr2=0x7ff7d8041be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:45.994 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.422+0000 7ff7f52c1640 1 --2- 172.21.15.79:0/649135767 >> v2:172.21.15.79:6800/3535502969 conn(0x7ff7d803f720 0x7ff7d8041be0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40098c0 tx=0x7ff7e4006db0 comp rx=0 tx=0).stop 2024-09-13T05:42:45.995 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.422+0000 7ff7f52c1640 1 -- 172.21.15.79:0/649135767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f0106960 msgr2=0x7ff7f019cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:45.995 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.422+0000 7ff7f52c1640 1 --2- 172.21.15.79:0/649135767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f0106960 0x7ff7f019cab0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0000c00 tx=0x7ff7e0032740 comp rx=0 tx=0).stop 2024-09-13T05:42:45.995 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.422+0000 7ff7f52c1640 1 -- 172.21.15.79:0/649135767 shutdown_connections 2024-09-13T05:42:45.995 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.422+0000 7ff7f52c1640 1 --2- 172.21.15.79:0/649135767 >> v2:172.21.15.79:6800/3535502969 conn(0x7ff7d803f720 0x7ff7d8041be0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:45.995 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.422+0000 7ff7f52c1640 1 --2- 172.21.15.79:0/649135767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7f0106960 0x7ff7f019cab0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:45.995 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.422+0000 7ff7f52c1640 1 -- 172.21.15.79:0/649135767 >> 172.21.15.79:0/649135767 conn(0x7ff7f0102230 msgr2=0x7ff7f0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:45.995 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.422+0000 7ff7f52c1640 1 -- 172.21.15.79:0/649135767 shutdown_connections 2024-09-13T05:42:45.995 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:45.422+0000 7ff7f52c1640 1 -- 172.21.15.79:0/649135767 wait complete. 2024-09-13T05:42:46.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:46 smithi079 bash[22814]: audit 2024-09-13T05:42:45.412943+0000 mgr.y (mgr.14118) 9 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:42:46.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:46 smithi079 bash[22814]: audit 2024-09-13T05:42:45.412943+0000 mgr.y (mgr.14118) 9 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:42:46.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:46 smithi079 bash[22814]: audit 2024-09-13T05:42:45.420307+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:46.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:46 smithi079 bash[22814]: audit 2024-09-13T05:42:45.420307+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:46.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:46 smithi079 bash[22814]: audit 2024-09-13T05:42:45.436700+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:42:46.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:46 smithi079 bash[22814]: audit 2024-09-13T05:42:45.436700+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:42:47.986 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:47 smithi079 bash[22814]: audit 2024-09-13T05:42:47.613466+0000 mgr.y (mgr.14118) 10 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:42:47.987 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:47 smithi079 bash[22814]: audit 2024-09-13T05:42:47.613466+0000 mgr.y (mgr.14118) 10 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:42:48.209 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T05:42:48.209 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f2019fe5640 1 Processor -- start 2024-09-13T05:42:48.209 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f2019fe5640 1 -- start start 2024-09-13T05:42:48.209 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f2019fe5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2014106940 0x7f2014106d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:48.209 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f2019fe5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2014107330 con 0x7f2014106940 2024-09-13T05:42:48.209 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f20137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2014106940 0x7f2014106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:48.209 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f20137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2014106940 0x7f2014106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50520/0 (socket says 172.21.15.79:50520) 2024-09-13T05:42:48.209 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f20137fe640 1 -- 172.21.15.79:0/2061848765 learned_addr learned my addr 172.21.15.79:0/2061848765 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:48.209 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f20137fe640 1 -- 172.21.15.79:0/2061848765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20141074b0 con 0x7f2014106940 2024-09-13T05:42:48.209 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f20137fe640 1 --2- 172.21.15.79:0/2061848765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2014106940 0x7f2014106d40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2004009820 tx=0x7f200402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3ae997c4921496 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:48.209 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f20127fc640 1 -- 172.21.15.79:0/2061848765 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2004037070 con 0x7f2014106940 2024-09-13T05:42:48.210 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f20127fc640 1 -- 172.21.15.79:0/2061848765 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f20040328a0 con 0x7f2014106940 2024-09-13T05:42:48.210 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f20127fc640 1 -- 172.21.15.79:0/2061848765 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2004030690 con 0x7f2014106940 2024-09-13T05:42:48.210 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f2019fe5640 1 -- 172.21.15.79:0/2061848765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2014106940 msgr2=0x7f2014106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:48.210 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f2019fe5640 1 --2- 172.21.15.79:0/2061848765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2014106940 0x7f2014106d40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2004009820 tx=0x7f200402a270 comp rx=0 tx=0).stop 2024-09-13T05:42:48.210 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f2019fe5640 1 -- 172.21.15.79:0/2061848765 shutdown_connections 2024-09-13T05:42:48.210 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f2019fe5640 1 --2- 172.21.15.79:0/2061848765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2014106940 0x7f2014106d40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:48.210 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f2019fe5640 1 -- 172.21.15.79:0/2061848765 >> 172.21.15.79:0/2061848765 conn(0x7f20141021d0 msgr2=0x7f2014104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:48.210 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.257+0000 7f2019fe5640 1 -- 172.21.15.79:0/2061848765 shutdown_connections 2024-09-13T05:42:48.210 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2019fe5640 1 -- 172.21.15.79:0/2061848765 wait complete. 2024-09-13T05:42:48.210 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2019fe5640 1 Processor -- start 2024-09-13T05:42:48.210 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2019fe5640 1 -- start start 2024-09-13T05:42:48.210 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2019fe5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2014106940 0x7f201419cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:48.210 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2019fe5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f201410adc0 con 0x7f2014106940 2024-09-13T05:42:48.211 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f20137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2014106940 0x7f201419cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:48.211 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f20137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2014106940 0x7f201419cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50532/0 (socket says 172.21.15.79:50532) 2024-09-13T05:42:48.211 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f20137fe640 1 -- 172.21.15.79:0/131375580 learned_addr learned my addr 172.21.15.79:0/131375580 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:48.211 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f20137fe640 1 -- 172.21.15.79:0/131375580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201419d060 con 0x7f2014106940 2024-09-13T05:42:48.211 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f20137fe640 1 --2- 172.21.15.79:0/131375580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2014106940 0x7f201419cb00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2004000c00 tx=0x7f2004030bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:48.211 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2010ff9640 1 -- 172.21.15.79:0/131375580 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2004042070 con 0x7f2014106940 2024-09-13T05:42:48.211 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2010ff9640 1 -- 172.21.15.79:0/131375580 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f2004030e00 con 0x7f2014106940 2024-09-13T05:42:48.211 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2019fe5640 1 -- 172.21.15.79:0/131375580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201419d2f0 con 0x7f2014106940 2024-09-13T05:42:48.211 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2010ff9640 1 -- 172.21.15.79:0/131375580 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2004037040 con 0x7f2014106940 2024-09-13T05:42:48.211 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2019fe5640 1 -- 172.21.15.79:0/131375580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201419dcb0 con 0x7f2014106940 2024-09-13T05:42:48.211 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2010ff9640 1 -- 172.21.15.79:0/131375580 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 9) ==== 51730+0+0 (secure 0 0 0) 0x7f2004045070 con 0x7f2014106940 2024-09-13T05:42:48.211 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2010ff9640 1 --2- 172.21.15.79:0/131375580 >> v2:172.21.15.79:6800/3535502969 conn(0x7f1ffc03f3c0 0x7f1ffc041880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:48.211 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2010ff9640 1 -- 172.21.15.79:0/131375580 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f2004079170 con 0x7f2014106940 2024-09-13T05:42:48.212 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2012ffd640 1 --2- 172.21.15.79:0/131375580 >> v2:172.21.15.79:6800/3535502969 conn(0x7f1ffc03f3c0 0x7f1ffc041880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:48.212 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2019fe5640 1 -- 172.21.15.79:0/131375580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2014106dc0 con 0x7f2014106940 2024-09-13T05:42:48.212 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.261+0000 7f2012ffd640 1 --2- 172.21.15.79:0/131375580 >> v2:172.21.15.79:6800/3535502969 conn(0x7f1ffc03f3c0 0x7f1ffc041880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f20080098c0 tx=0x7f2008006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:48.212 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.269+0000 7f2010ff9640 1 -- 172.21.15.79:0/131375580 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f200403da20 con 0x7f2014106940 2024-09-13T05:42:48.212 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.609+0000 7f2019fe5640 1 -- 172.21.15.79:0/131375580 --> v2:172.21.15.79:6800/3535502969 -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f2014103380 con 0x7f1ffc03f3c0 2024-09-13T05:42:48.212 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.609+0000 7f2010ff9640 1 -- 172.21.15.79:0/131375580 <== mgr.14118 v2:172.21.15.79:6800/3535502969 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f2014103380 con 0x7f1ffc03f3c0 2024-09-13T05:42:48.212 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.613+0000 7f2019fe5640 1 -- 172.21.15.79:0/131375580 >> v2:172.21.15.79:6800/3535502969 conn(0x7f1ffc03f3c0 msgr2=0x7f1ffc041880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:48.212 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.613+0000 7f2019fe5640 1 --2- 172.21.15.79:0/131375580 >> v2:172.21.15.79:6800/3535502969 conn(0x7f1ffc03f3c0 0x7f1ffc041880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f20080098c0 tx=0x7f2008006db0 comp rx=0 tx=0).stop 2024-09-13T05:42:48.212 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.613+0000 7f2019fe5640 1 -- 172.21.15.79:0/131375580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2014106940 msgr2=0x7f201419cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:48.212 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.613+0000 7f2019fe5640 1 --2- 172.21.15.79:0/131375580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2014106940 0x7f201419cb00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2004000c00 tx=0x7f2004030bc0 comp rx=0 tx=0).stop 2024-09-13T05:42:48.212 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.613+0000 7f2019fe5640 1 -- 172.21.15.79:0/131375580 shutdown_connections 2024-09-13T05:42:48.212 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.613+0000 7f2019fe5640 1 --2- 172.21.15.79:0/131375580 >> v2:172.21.15.79:6800/3535502969 conn(0x7f1ffc03f3c0 0x7f1ffc041880 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:48.212 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.613+0000 7f2019fe5640 1 --2- 172.21.15.79:0/131375580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2014106940 0x7f201419cb00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:48.213 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.613+0000 7f2019fe5640 1 -- 172.21.15.79:0/131375580 >> 172.21.15.79:0/131375580 conn(0x7f20141021d0 msgr2=0x7f2014102c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:48.213 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.613+0000 7f2019fe5640 1 -- 172.21.15.79:0/131375580 shutdown_connections 2024-09-13T05:42:48.213 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:47.613+0000 7f2019fe5640 1 -- 172.21.15.79:0/131375580 wait complete. 2024-09-13T05:42:48.213 INFO:teuthology.orchestra.run.smithi079.stdout:Generating ssh key... 2024-09-13T05:42:50.137 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[22814]: audit 2024-09-13T05:42:49.686656+0000 mgr.y (mgr.14118) 11 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:42:50.138 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[22814]: audit 2024-09-13T05:42:49.686656+0000 mgr.y (mgr.14118) 11 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:42:50.138 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[22814]: cephadm 2024-09-13T05:42:49.687073+0000 mgr.y (mgr.14118) 12 : cephadm [INF] Generating ssh key... 2024-09-13T05:42:50.138 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[22814]: cephadm 2024-09-13T05:42:49.687073+0000 mgr.y (mgr.14118) 12 : cephadm [INF] Generating ssh key... 2024-09-13T05:42:50.138 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: Generating public/private rsa key pair. 2024-09-13T05:42:50.138 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: Your identification has been saved in /tmp/tmpvlewcuin/key 2024-09-13T05:42:50.138 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: Your public key has been saved in /tmp/tmpvlewcuin/key.pub 2024-09-13T05:42:50.138 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: The key fingerprint is: 2024-09-13T05:42:50.138 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: SHA256:lBSimABLt94XN9QzzlC22D+LGFxmkkQ08uWE0/49P/w ceph-bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:50.139 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: The key's randomart image is: 2024-09-13T05:42:50.139 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: +---[RSA 3072]----+ 2024-09-13T05:42:50.139 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: |+. . ..=B== | 2024-09-13T05:42:50.139 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: |.o.o.. o==X=. | 2024-09-13T05:42:50.139 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: |. o.. .oB*Bo | 2024-09-13T05:42:50.139 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: | . . .+ *+. | 2024-09-13T05:42:50.139 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: | . . .So .o. | 2024-09-13T05:42:50.139 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: | . o ..oo | 2024-09-13T05:42:50.139 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: | . . .. o| 2024-09-13T05:42:50.139 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: | o.| 2024-09-13T05:42:50.139 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: | E| 2024-09-13T05:42:50.139 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:42:49 smithi079 bash[23069]: +----[SHA256]-----+ 2024-09-13T05:42:50.531 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.333+0000 7f84cf2d5640 1 Processor -- start 2024-09-13T05:42:50.531 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.333+0000 7f84cf2d5640 1 -- start start 2024-09-13T05:42:50.531 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.333+0000 7f84cf2d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c8108b40 0x7f84c8108f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:50.531 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.333+0000 7f84cf2d5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84c8109530 con 0x7f84c8108b40 2024-09-13T05:42:50.531 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.333+0000 7f84cd071640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c8108b40 0x7f84c8108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:50.531 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.333+0000 7f84cd071640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c8108b40 0x7f84c8108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50542/0 (socket says 172.21.15.79:50542) 2024-09-13T05:42:50.531 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.333+0000 7f84cd071640 1 -- 172.21.15.79:0/318906359 learned_addr learned my addr 172.21.15.79:0/318906359 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:50.532 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cd071640 1 -- 172.21.15.79:0/318906359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c81096b0 con 0x7f84c8108b40 2024-09-13T05:42:50.532 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cd071640 1 --2- 172.21.15.79:0/318906359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c8108b40 0x7f84c8108f40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009e80 tx=0x7f84b802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83b95065e7e839c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:50.532 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84c7fff640 1 -- 172.21.15.79:0/318906359 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b8036070 con 0x7f84c8108b40 2024-09-13T05:42:50.532 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84c7fff640 1 -- 172.21.15.79:0/318906359 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f84b8031860 con 0x7f84c8108b40 2024-09-13T05:42:50.532 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84c7fff640 1 -- 172.21.15.79:0/318906359 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b8007880 con 0x7f84c8108b40 2024-09-13T05:42:50.532 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cf2d5640 1 -- 172.21.15.79:0/318906359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c8108b40 msgr2=0x7f84c8108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:50.532 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cf2d5640 1 --2- 172.21.15.79:0/318906359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c8108b40 0x7f84c8108f40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009e80 tx=0x7f84b802a7a0 comp rx=0 tx=0).stop 2024-09-13T05:42:50.532 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cf2d5640 1 -- 172.21.15.79:0/318906359 shutdown_connections 2024-09-13T05:42:50.532 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cf2d5640 1 --2- 172.21.15.79:0/318906359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c8108b40 0x7f84c8108f40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:50.532 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cf2d5640 1 -- 172.21.15.79:0/318906359 >> 172.21.15.79:0/318906359 conn(0x7f84c807c350 msgr2=0x7f84c807c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:50.532 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cf2d5640 1 -- 172.21.15.79:0/318906359 shutdown_connections 2024-09-13T05:42:50.532 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cf2d5640 1 -- 172.21.15.79:0/318906359 wait complete. 2024-09-13T05:42:50.533 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cf2d5640 1 Processor -- start 2024-09-13T05:42:50.533 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cf2d5640 1 -- start start 2024-09-13T05:42:50.533 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cf2d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c8108b40 0x7f84c819caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:50.533 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cf2d5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84c810cfc0 con 0x7f84c8108b40 2024-09-13T05:42:50.533 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cd071640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c8108b40 0x7f84c819caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:50.533 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cd071640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c8108b40 0x7f84c819caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50552/0 (socket says 172.21.15.79:50552) 2024-09-13T05:42:50.533 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cd071640 1 -- 172.21.15.79:0/3882994252 learned_addr learned my addr 172.21.15.79:0/3882994252 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:50.533 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.337+0000 7f84cd071640 1 -- 172.21.15.79:0/3882994252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c819d000 con 0x7f84c8108b40 2024-09-13T05:42:50.533 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.341+0000 7f84cd071640 1 --2- 172.21.15.79:0/3882994252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c8108b40 0x7f84c819caa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f84b8008dc0 tx=0x7f84b8008df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:50.533 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.341+0000 7f84c67fc640 1 -- 172.21.15.79:0/3882994252 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b8041020 con 0x7f84c8108b40 2024-09-13T05:42:50.533 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.341+0000 7f84c67fc640 1 -- 172.21.15.79:0/3882994252 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f84b8031a10 con 0x7f84c8108b40 2024-09-13T05:42:50.533 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.341+0000 7f84cf2d5640 1 -- 172.21.15.79:0/3882994252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c819d290 con 0x7f84c8108b40 2024-09-13T05:42:50.533 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.341+0000 7f84cf2d5640 1 -- 172.21.15.79:0/3882994252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c819dcd0 con 0x7f84c8108b40 2024-09-13T05:42:50.534 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.341+0000 7f84c67fc640 1 -- 172.21.15.79:0/3882994252 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b8036040 con 0x7f84c8108b40 2024-09-13T05:42:50.534 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.341+0000 7f84c67fc640 1 -- 172.21.15.79:0/3882994252 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 9) ==== 51730+0+0 (secure 0 0 0) 0x7f84b8044020 con 0x7f84c8108b40 2024-09-13T05:42:50.534 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.341+0000 7f84cf2d5640 1 -- 172.21.15.79:0/3882994252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c8108fc0 con 0x7f84c8108b40 2024-09-13T05:42:50.534 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.341+0000 7f84c67fc640 1 --2- 172.21.15.79:0/3882994252 >> v2:172.21.15.79:6800/3535502969 conn(0x7f84b003f720 0x7f84b0041be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:50.534 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.341+0000 7f84c67fc640 1 -- 172.21.15.79:0/3882994252 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f84b8075550 con 0x7f84c8108b40 2024-09-13T05:42:50.534 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.341+0000 7f84cc870640 1 --2- 172.21.15.79:0/3882994252 >> v2:172.21.15.79:6800/3535502969 conn(0x7f84b003f720 0x7f84b0041be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:50.534 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.341+0000 7f84cc870640 1 --2- 172.21.15.79:0/3882994252 >> v2:172.21.15.79:6800/3535502969 conn(0x7f84b003f720 0x7f84b0041be0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0098c0 tx=0x7f84bc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:50.534 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.345+0000 7f84c67fc640 1 -- 172.21.15.79:0/3882994252 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f84b804b020 con 0x7f84c8108b40 2024-09-13T05:42:50.534 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.681+0000 7f84cf2d5640 1 -- 172.21.15.79:0/3882994252 --> v2:172.21.15.79:6800/3535502969 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f84c8106dc0 con 0x7f84b003f720 2024-09-13T05:42:50.534 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.897+0000 7f84c67fc640 1 -- 172.21.15.79:0/3882994252 <== mgr.14118 v2:172.21.15.79:6800/3535502969 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f84c8106dc0 con 0x7f84b003f720 2024-09-13T05:42:50.534 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.901+0000 7f84cf2d5640 1 -- 172.21.15.79:0/3882994252 >> v2:172.21.15.79:6800/3535502969 conn(0x7f84b003f720 msgr2=0x7f84b0041be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:50.534 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.901+0000 7f84cf2d5640 1 --2- 172.21.15.79:0/3882994252 >> v2:172.21.15.79:6800/3535502969 conn(0x7f84b003f720 0x7f84b0041be0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0098c0 tx=0x7f84bc006db0 comp rx=0 tx=0).stop 2024-09-13T05:42:50.535 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.901+0000 7f84cf2d5640 1 -- 172.21.15.79:0/3882994252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c8108b40 msgr2=0x7f84c819caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:50.535 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.901+0000 7f84cf2d5640 1 --2- 172.21.15.79:0/3882994252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c8108b40 0x7f84c819caa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f84b8008dc0 tx=0x7f84b8008df0 comp rx=0 tx=0).stop 2024-09-13T05:42:50.535 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.901+0000 7f84cf2d5640 1 -- 172.21.15.79:0/3882994252 shutdown_connections 2024-09-13T05:42:50.535 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.901+0000 7f84cf2d5640 1 --2- 172.21.15.79:0/3882994252 >> v2:172.21.15.79:6800/3535502969 conn(0x7f84b003f720 0x7f84b0041be0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:50.535 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.901+0000 7f84cf2d5640 1 --2- 172.21.15.79:0/3882994252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c8108b40 0x7f84c819caa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:50.535 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.901+0000 7f84cf2d5640 1 -- 172.21.15.79:0/3882994252 >> 172.21.15.79:0/3882994252 conn(0x7f84c807c350 msgr2=0x7f84c81066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:50.535 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.901+0000 7f84cf2d5640 1 -- 172.21.15.79:0/3882994252 shutdown_connections 2024-09-13T05:42:50.535 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:49.901+0000 7f84cf2d5640 1 -- 172.21.15.79:0/3882994252 wait complete. 2024-09-13T05:42:51.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:50 smithi079 bash[22814]: audit 2024-09-13T05:42:49.894581+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:51.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:50 smithi079 bash[22814]: audit 2024-09-13T05:42:49.894581+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:51.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:50 smithi079 bash[22814]: audit 2024-09-13T05:42:49.899971+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:51.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:50 smithi079 bash[22814]: audit 2024-09-13T05:42:49.899971+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:52.521 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8fvXQ3DIiV3gosR5/+cPPjTeDD8bjes0hjuqqiVKhv2+Tt0MBDS0BShymlMKdDl8f4pi/no+tcXNO2KlPRBYzjdEPcvu0v6TY5J+ghK1pYpqsOnUbkAhCchTwfNJWKSDdjjX0j8S2CdUXVYL6o9HIVfP0UmCHaLhFaw5nrwixZL6BIzQJsyao6VFfZy+03IQohxe/curNywrxnMA0zld+Yeokrs6GsWjcDwVtBHJpaDfJlUuhlRWu9CNTVju3T/3uQh2YZbHt3yAQR2xrLBYt1fDXIVV1xPZpZUQsY2eIM0Un8etcSo58L27aURgZL9KBZv4jFTiNPgjTtGI49o3Ghe5gHDiBWaBm1M7ZSZzrYFZtEf8tL48UJ6rF8OeXDkV7oNfki35NsT0C8W16Ij4bKko0X67fFc0JIupbBQPSDqa5u7jchx2hLQuSobHek7/OoOzhjfj+6oUNhkXKKsEXw45Gpnd9mgPKyBUwHMv/zMBnzilD7oZi7KzoAVqCH5k= ceph-bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:42:52.521 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f58421e1640 1 Processor -- start 2024-09-13T05:42:52.521 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f58421e1640 1 -- start start 2024-09-13T05:42:52.521 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f58421e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f583c107f50 0x7f583c108350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:52.521 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f58421e1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f583c108890 con 0x7f583c107f50 2024-09-13T05:42:52.521 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f583b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f583c107f50 0x7f583c108350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:52.521 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f583b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f583c107f50 0x7f583c108350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50554/0 (socket says 172.21.15.79:50554) 2024-09-13T05:42:52.521 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f583b7fe640 1 -- 172.21.15.79:0/811134826 learned_addr learned my addr 172.21.15.79:0/811134826 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f583b7fe640 1 -- 172.21.15.79:0/811134826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f583c108a10 con 0x7f583c107f50 2024-09-13T05:42:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f583b7fe640 1 --2- 172.21.15.79:0/811134826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f583c107f50 0x7f583c108350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5834009820 tx=0x7f583402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887c66b39c85e1ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f583a7fc640 1 -- 172.21.15.79:0/811134826 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5834037070 con 0x7f583c107f50 2024-09-13T05:42:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f583a7fc640 1 -- 172.21.15.79:0/811134826 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f58340328a0 con 0x7f583c107f50 2024-09-13T05:42:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f583a7fc640 1 -- 172.21.15.79:0/811134826 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5834030690 con 0x7f583c107f50 2024-09-13T05:42:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f58421e1640 1 -- 172.21.15.79:0/811134826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f583c107f50 msgr2=0x7f583c108350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f58421e1640 1 --2- 172.21.15.79:0/811134826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f583c107f50 0x7f583c108350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5834009820 tx=0x7f583402a270 comp rx=0 tx=0).stop 2024-09-13T05:42:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f58421e1640 1 -- 172.21.15.79:0/811134826 shutdown_connections 2024-09-13T05:42:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f58421e1640 1 --2- 172.21.15.79:0/811134826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f583c107f50 0x7f583c108350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f58421e1640 1 -- 172.21.15.79:0/811134826 >> 172.21.15.79:0/811134826 conn(0x7f583c1008e0 msgr2=0x7f583c102d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f58421e1640 1 -- 172.21.15.79:0/811134826 shutdown_connections 2024-09-13T05:42:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f58421e1640 1 -- 172.21.15.79:0/811134826 wait complete. 2024-09-13T05:42:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.605+0000 7f58421e1640 1 Processor -- start 2024-09-13T05:42:52.522 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f58421e1640 1 -- start start 2024-09-13T05:42:52.523 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f58421e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f583c107f50 0x7f583c19a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:52.523 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f58421e1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f583c105730 con 0x7f583c107f50 2024-09-13T05:42:52.523 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f583b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f583c107f50 0x7f583c19a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:52.523 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f583b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f583c107f50 0x7f583c19a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50570/0 (socket says 172.21.15.79:50570) 2024-09-13T05:42:52.523 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f583b7fe640 1 -- 172.21.15.79:0/2216485683 learned_addr learned my addr 172.21.15.79:0/2216485683 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:52.523 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f583b7fe640 1 -- 172.21.15.79:0/2216485683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f583c19ae20 con 0x7f583c107f50 2024-09-13T05:42:52.523 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f583b7fe640 1 --2- 172.21.15.79:0/2216485683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f583c107f50 0x7f583c19a8c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5834000c00 tx=0x7f5834032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:52.523 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f5838ff9640 1 -- 172.21.15.79:0/2216485683 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5834037040 con 0x7f583c107f50 2024-09-13T05:42:52.523 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f5838ff9640 1 -- 172.21.15.79:0/2216485683 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f5834040070 con 0x7f583c107f50 2024-09-13T05:42:52.523 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f58421e1640 1 -- 172.21.15.79:0/2216485683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f583c19b0b0 con 0x7f583c107f50 2024-09-13T05:42:52.523 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f5838ff9640 1 -- 172.21.15.79:0/2216485683 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583403be40 con 0x7f583c107f50 2024-09-13T05:42:52.523 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f58421e1640 1 -- 172.21.15.79:0/2216485683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f583c19ba70 con 0x7f583c107f50 2024-09-13T05:42:52.523 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f5838ff9640 1 -- 172.21.15.79:0/2216485683 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 9) ==== 51730+0+0 (secure 0 0 0) 0x7f5834045460 con 0x7f583c107f50 2024-09-13T05:42:52.524 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f58421e1640 1 -- 172.21.15.79:0/2216485683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f583c1083d0 con 0x7f583c107f50 2024-09-13T05:42:52.524 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f5838ff9640 1 --2- 172.21.15.79:0/2216485683 >> v2:172.21.15.79:6800/3535502969 conn(0x7f582803f6d0 0x7f5828041b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:52.524 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f5838ff9640 1 -- 172.21.15.79:0/2216485683 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f5834073ce0 con 0x7f583c107f50 2024-09-13T05:42:52.524 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f583affd640 1 --2- 172.21.15.79:0/2216485683 >> v2:172.21.15.79:6800/3535502969 conn(0x7f582803f6d0 0x7f5828041b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:52.524 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.609+0000 7f583affd640 1 --2- 172.21.15.79:0/2216485683 >> v2:172.21.15.79:6800/3535502969 conn(0x7f582803f6d0 0x7f5828041b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58240098c0 tx=0x7f5824006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:52.524 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.613+0000 7f5838ff9640 1 -- 172.21.15.79:0/2216485683 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f583403b430 con 0x7f583c107f50 2024-09-13T05:42:52.524 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.953+0000 7f58421e1640 1 -- 172.21.15.79:0/2216485683 --> v2:172.21.15.79:6800/3535502969 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f583c101b40 con 0x7f582803f6d0 2024-09-13T05:42:52.524 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.953+0000 7f5838ff9640 1 -- 172.21.15.79:0/2216485683 <== mgr.14118 v2:172.21.15.79:6800/3535502969 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f583c101b40 con 0x7f582803f6d0 2024-09-13T05:42:52.524 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.957+0000 7f58421e1640 1 -- 172.21.15.79:0/2216485683 >> v2:172.21.15.79:6800/3535502969 conn(0x7f582803f6d0 msgr2=0x7f5828041b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:52.524 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.957+0000 7f58421e1640 1 --2- 172.21.15.79:0/2216485683 >> v2:172.21.15.79:6800/3535502969 conn(0x7f582803f6d0 0x7f5828041b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58240098c0 tx=0x7f5824006db0 comp rx=0 tx=0).stop 2024-09-13T05:42:52.524 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.957+0000 7f58421e1640 1 -- 172.21.15.79:0/2216485683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f583c107f50 msgr2=0x7f583c19a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:52.524 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.957+0000 7f58421e1640 1 --2- 172.21.15.79:0/2216485683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f583c107f50 0x7f583c19a8c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5834000c00 tx=0x7f5834032740 comp rx=0 tx=0).stop 2024-09-13T05:42:52.524 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.957+0000 7f58421e1640 1 -- 172.21.15.79:0/2216485683 shutdown_connections 2024-09-13T05:42:52.525 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.957+0000 7f58421e1640 1 --2- 172.21.15.79:0/2216485683 >> v2:172.21.15.79:6800/3535502969 conn(0x7f582803f6d0 0x7f5828041b90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:52.525 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.957+0000 7f58421e1640 1 --2- 172.21.15.79:0/2216485683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f583c107f50 0x7f583c19a8c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:52.525 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.957+0000 7f58421e1640 1 -- 172.21.15.79:0/2216485683 >> 172.21.15.79:0/2216485683 conn(0x7f583c1008e0 msgr2=0x7f583c101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:52.525 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.957+0000 7f58421e1640 1 -- 172.21.15.79:0/2216485683 shutdown_connections 2024-09-13T05:42:52.525 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:51.957+0000 7f58421e1640 1 -- 172.21.15.79:0/2216485683 wait complete. 2024-09-13T05:42:52.525 INFO:teuthology.orchestra.run.smithi079.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T05:42:52.525 INFO:teuthology.orchestra.run.smithi079.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T05:42:52.526 INFO:teuthology.orchestra.run.smithi079.stdout:Adding host smithi079... 2024-09-13T05:42:52.987 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:52 smithi079 bash[22814]: audit 2024-09-13T05:42:51.958491+0000 mgr.y (mgr.14118) 13 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:42:52.987 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:52 smithi079 bash[22814]: audit 2024-09-13T05:42:51.958491+0000 mgr.y (mgr.14118) 13 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:42:54.918 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:54 smithi079 bash[22814]: audit 2024-09-13T05:42:54.102716+0000 mgr.y (mgr.14118) 14 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi079", "addr": "172.21.15.79", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:42:54.918 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:54 smithi079 bash[22814]: audit 2024-09-13T05:42:54.102716+0000 mgr.y (mgr.14118) 14 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi079", "addr": "172.21.15.79", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:42:56.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:55 smithi079 bash[22814]: cephadm 2024-09-13T05:42:55.049619+0000 mgr.y (mgr.14118) 15 : cephadm [INF] Deploying cephadm binary to smithi079 2024-09-13T05:42:56.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:55 smithi079 bash[22814]: cephadm 2024-09-13T05:42:55.049619+0000 mgr.y (mgr.14118) 15 : cephadm [INF] Deploying cephadm binary to smithi079 2024-09-13T05:42:58.943 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Added host 'smithi079' with addr '172.21.15.79' 2024-09-13T05:42:58.978 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.741+0000 7f899606a640 1 Processor -- start 2024-09-13T05:42:58.979 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.741+0000 7f899606a640 1 -- start start 2024-09-13T05:42:58.979 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.741+0000 7f899606a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8990106960 0x7f8990106d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:58.979 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.741+0000 7f899606a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8990107350 con 0x7f8990106960 2024-09-13T05:42:58.979 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.741+0000 7f898f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8990106960 0x7f8990106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:58.979 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f898f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8990106960 0x7f8990106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49008/0 (socket says 172.21.15.79:49008) 2024-09-13T05:42:58.979 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f898f7fe640 1 -- 172.21.15.79:0/1486936733 learned_addr learned my addr 172.21.15.79:0/1486936733 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:58.979 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f898f7fe640 1 -- 172.21.15.79:0/1486936733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89901074d0 con 0x7f8990106960 2024-09-13T05:42:58.979 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f898f7fe640 1 --2- 172.21.15.79:0/1486936733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8990106960 0x7f8990106d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8980009820 tx=0x7f898002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9da493c4ca124f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:58.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f898effd640 1 -- 172.21.15.79:0/1486936733 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8980037070 con 0x7f8990106960 2024-09-13T05:42:58.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f898effd640 1 -- 172.21.15.79:0/1486936733 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f89800328a0 con 0x7f8990106960 2024-09-13T05:42:58.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f898effd640 1 -- 172.21.15.79:0/1486936733 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8980030690 con 0x7f8990106960 2024-09-13T05:42:58.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f899606a640 1 -- 172.21.15.79:0/1486936733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8990106960 msgr2=0x7f8990106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:58.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f899606a640 1 --2- 172.21.15.79:0/1486936733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8990106960 0x7f8990106d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8980009820 tx=0x7f898002a270 comp rx=0 tx=0).stop 2024-09-13T05:42:58.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f899606a640 1 -- 172.21.15.79:0/1486936733 shutdown_connections 2024-09-13T05:42:58.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f899606a640 1 --2- 172.21.15.79:0/1486936733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8990106960 0x7f8990106d60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:58.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f899606a640 1 -- 172.21.15.79:0/1486936733 >> 172.21.15.79:0/1486936733 conn(0x7f8990102250 msgr2=0x7f8990104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:58.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f899606a640 1 -- 172.21.15.79:0/1486936733 shutdown_connections 2024-09-13T05:42:58.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f899606a640 1 -- 172.21.15.79:0/1486936733 wait complete. 2024-09-13T05:42:58.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f899606a640 1 Processor -- start 2024-09-13T05:42:58.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f899606a640 1 -- start start 2024-09-13T05:42:58.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f899606a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8990106960 0x7f899019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:58.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f899606a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f899010ade0 con 0x7f8990106960 2024-09-13T05:42:58.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f898f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8990106960 0x7f899019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:58.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f898f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8990106960 0x7f899019a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49012/0 (socket says 172.21.15.79:49012) 2024-09-13T05:42:58.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f898f7fe640 1 -- 172.21.15.79:0/1526612737 learned_addr learned my addr 172.21.15.79:0/1526612737 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:42:58.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f898f7fe640 1 -- 172.21.15.79:0/1526612737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899019ae40 con 0x7f8990106960 2024-09-13T05:42:58.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.745+0000 7f898f7fe640 1 --2- 172.21.15.79:0/1526612737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8990106960 0x7f899019a8e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8980000c00 tx=0x7f8980032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:58.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.749+0000 7f898d7fa640 1 -- 172.21.15.79:0/1526612737 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8980037040 con 0x7f8990106960 2024-09-13T05:42:58.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.749+0000 7f898d7fa640 1 -- 172.21.15.79:0/1526612737 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f8980040070 con 0x7f8990106960 2024-09-13T05:42:58.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.749+0000 7f899606a640 1 -- 172.21.15.79:0/1526612737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899019b0d0 con 0x7f8990106960 2024-09-13T05:42:58.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.749+0000 7f898d7fa640 1 -- 172.21.15.79:0/1526612737 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f898003be40 con 0x7f8990106960 2024-09-13T05:42:58.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.749+0000 7f899606a640 1 -- 172.21.15.79:0/1526612737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899019ba90 con 0x7f8990106960 2024-09-13T05:42:58.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.749+0000 7f898d7fa640 1 -- 172.21.15.79:0/1526612737 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 9) ==== 51730+0+0 (secure 0 0 0) 0x7f898003b680 con 0x7f8990106960 2024-09-13T05:42:58.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.749+0000 7f899606a640 1 -- 172.21.15.79:0/1526612737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8990106de0 con 0x7f8990106960 2024-09-13T05:42:58.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.749+0000 7f898d7fa640 1 --2- 172.21.15.79:0/1526612737 >> v2:172.21.15.79:6800/3535502969 conn(0x7f897c03f720 0x7f897c041be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:42:58.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.749+0000 7f898d7fa640 1 -- 172.21.15.79:0/1526612737 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f8980073860 con 0x7f8990106960 2024-09-13T05:42:58.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.749+0000 7f8987fff640 1 --2- 172.21.15.79:0/1526612737 >> v2:172.21.15.79:6800/3535502969 conn(0x7f897c03f720 0x7f897c041be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:42:58.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.749+0000 7f8987fff640 1 --2- 172.21.15.79:0/1526612737 >> v2:172.21.15.79:6800/3535502969 conn(0x7f897c03f720 0x7f897c041be0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f89780098c0 tx=0x7f8978006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:42:58.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:53.757+0000 7f898d7fa640 1 -- 172.21.15.79:0/1526612737 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f898004a060 con 0x7f8990106960 2024-09-13T05:42:58.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:54.097+0000 7f899606a640 1 -- 172.21.15.79:0/1526612737 --> v2:172.21.15.79:6800/3535502969 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi079", "addr": "172.21.15.79", "target": ["mon-mgr", ""]}) -- 0x7f899019c2f0 con 0x7f897c03f720 2024-09-13T05:42:58.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:58.133+0000 7f898d7fa640 1 -- 172.21.15.79:0/1526612737 <== mgr.14118 v2:172.21.15.79:6800/3535502969 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f899019c2f0 con 0x7f897c03f720 2024-09-13T05:42:58.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:58.137+0000 7f899606a640 1 -- 172.21.15.79:0/1526612737 >> v2:172.21.15.79:6800/3535502969 conn(0x7f897c03f720 msgr2=0x7f897c041be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:58.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:58.137+0000 7f899606a640 1 --2- 172.21.15.79:0/1526612737 >> v2:172.21.15.79:6800/3535502969 conn(0x7f897c03f720 0x7f897c041be0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f89780098c0 tx=0x7f8978006db0 comp rx=0 tx=0).stop 2024-09-13T05:42:58.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:58.137+0000 7f899606a640 1 -- 172.21.15.79:0/1526612737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8990106960 msgr2=0x7f899019a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:42:58.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:58.137+0000 7f899606a640 1 --2- 172.21.15.79:0/1526612737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8990106960 0x7f899019a8e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8980000c00 tx=0x7f8980032740 comp rx=0 tx=0).stop 2024-09-13T05:42:58.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:58.137+0000 7f899606a640 1 -- 172.21.15.79:0/1526612737 shutdown_connections 2024-09-13T05:42:58.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:58.137+0000 7f899606a640 1 --2- 172.21.15.79:0/1526612737 >> v2:172.21.15.79:6800/3535502969 conn(0x7f897c03f720 0x7f897c041be0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:58.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:58.137+0000 7f899606a640 1 --2- 172.21.15.79:0/1526612737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8990106960 0x7f899019a8e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:42:58.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:58.137+0000 7f899606a640 1 -- 172.21.15.79:0/1526612737 >> 172.21.15.79:0/1526612737 conn(0x7f8990102250 msgr2=0x7f8990102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:42:58.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:58.137+0000 7f899606a640 1 -- 172.21.15.79:0/1526612737 shutdown_connections 2024-09-13T05:42:58.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:42:58.137+0000 7f899606a640 1 -- 172.21.15.79:0/1526612737 wait complete. 2024-09-13T05:42:58.986 INFO:teuthology.orchestra.run.smithi079.stdout:Deploying unmanaged mon service... 2024-09-13T05:42:59.376 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:59 smithi079 bash[22814]: audit 2024-09-13T05:42:58.135959+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:59.376 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:59 smithi079 bash[22814]: audit 2024-09-13T05:42:58.135959+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:42:59.376 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:59 smithi079 bash[22814]: cephadm 2024-09-13T05:42:58.136444+0000 mgr.y (mgr.14118) 16 : cephadm [INF] Added host smithi079 2024-09-13T05:42:59.376 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:59 smithi079 bash[22814]: cephadm 2024-09-13T05:42:58.136444+0000 mgr.y (mgr.14118) 16 : cephadm [INF] Added host smithi079 2024-09-13T05:42:59.377 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:59 smithi079 bash[22814]: audit 2024-09-13T05:42:58.136826+0000 mon.a (mon.0) 65 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:42:59.377 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:42:59 smithi079 bash[22814]: audit 2024-09-13T05:42:58.136826+0000 mon.a (mon.0) 65 : audit [DBG] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:43:01.046 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:00 smithi079 bash[22814]: cluster 2024-09-13T05:42:59.738805+0000 mgr.y (mgr.14118) 17 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:01.046 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:00 smithi079 bash[22814]: cluster 2024-09-13T05:42:59.738805+0000 mgr.y (mgr.14118) 17 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:01.834 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T05:43:01.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.629+0000 7f7f6900d640 1 Processor -- start 2024-09-13T05:43:01.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.629+0000 7f7f6900d640 1 -- start start 2024-09-13T05:43:01.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.629+0000 7f7f6900d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f64106940 0x7f7f64106d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:01.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.629+0000 7f7f6900d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f64107330 con 0x7f7f64106940 2024-09-13T05:43:01.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.629+0000 7f7f62d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f64106940 0x7f7f64106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:01.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.629+0000 7f7f62d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f64106940 0x7f7f64106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49026/0 (socket says 172.21.15.79:49026) 2024-09-13T05:43:01.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.629+0000 7f7f62d9d640 1 -- 172.21.15.79:0/3435052399 learned_addr learned my addr 172.21.15.79:0/3435052399 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:01.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f62d9d640 1 -- 172.21.15.79:0/3435052399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f641074b0 con 0x7f7f64106940 2024-09-13T05:43:01.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f62d9d640 1 --2- 172.21.15.79:0/3435052399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f64106940 0x7f7f64106d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009820 tx=0x7f7f5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1b1c7d2b6d40de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:01.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f61d9b640 1 -- 172.21.15.79:0/3435052399 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f54037070 con 0x7f7f64106940 2024-09-13T05:43:01.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f61d9b640 1 -- 172.21.15.79:0/3435052399 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f7f540328a0 con 0x7f7f64106940 2024-09-13T05:43:01.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f61d9b640 1 -- 172.21.15.79:0/3435052399 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f54030690 con 0x7f7f64106940 2024-09-13T05:43:01.836 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f6900d640 1 -- 172.21.15.79:0/3435052399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f64106940 msgr2=0x7f7f64106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:01.836 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f6900d640 1 --2- 172.21.15.79:0/3435052399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f64106940 0x7f7f64106d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009820 tx=0x7f7f5402a270 comp rx=0 tx=0).stop 2024-09-13T05:43:01.836 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f6900d640 1 -- 172.21.15.79:0/3435052399 shutdown_connections 2024-09-13T05:43:01.836 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f6900d640 1 --2- 172.21.15.79:0/3435052399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f64106940 0x7f7f64106d40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:01.836 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f6900d640 1 -- 172.21.15.79:0/3435052399 >> 172.21.15.79:0/3435052399 conn(0x7f7f641021d0 msgr2=0x7f7f64104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:01.836 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f6900d640 1 -- 172.21.15.79:0/3435052399 shutdown_connections 2024-09-13T05:43:01.836 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f6900d640 1 -- 172.21.15.79:0/3435052399 wait complete. 2024-09-13T05:43:01.836 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f6900d640 1 Processor -- start 2024-09-13T05:43:01.836 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f6900d640 1 -- start start 2024-09-13T05:43:01.836 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f6900d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f64106940 0x7f7f6419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:01.836 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f6900d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6410adc0 con 0x7f7f64106940 2024-09-13T05:43:01.836 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f62d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f64106940 0x7f7f6419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f62d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f64106940 0x7f7f6419a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49038/0 (socket says 172.21.15.79:49038) 2024-09-13T05:43:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f62d9d640 1 -- 172.21.15.79:0/1317549258 learned_addr learned my addr 172.21.15.79:0/1317549258 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.633+0000 7f7f62d9d640 1 -- 172.21.15.79:0/1317549258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6419ae90 con 0x7f7f64106940 2024-09-13T05:43:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.637+0000 7f7f62d9d640 1 --2- 172.21.15.79:0/1317549258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f64106940 0x7f7f6419a930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7f54006f10 tx=0x7f7f54030c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.637+0000 7f7f4bfff640 1 -- 172.21.15.79:0/1317549258 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f54042070 con 0x7f7f64106940 2024-09-13T05:43:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.637+0000 7f7f6900d640 1 -- 172.21.15.79:0/1317549258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6419b120 con 0x7f7f64106940 2024-09-13T05:43:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.637+0000 7f7f4bfff640 1 -- 172.21.15.79:0/1317549258 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1023+0+0 (secure 0 0 0) 0x7f7f54030dd0 con 0x7f7f64106940 2024-09-13T05:43:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.637+0000 7f7f4bfff640 1 -- 172.21.15.79:0/1317549258 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f54037040 con 0x7f7f64106940 2024-09-13T05:43:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.637+0000 7f7f6900d640 1 -- 172.21.15.79:0/1317549258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6419bae0 con 0x7f7f64106940 2024-09-13T05:43:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.637+0000 7f7f4bfff640 1 -- 172.21.15.79:0/1317549258 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 9) ==== 51730+0+0 (secure 0 0 0) 0x7f7f54045070 con 0x7f7f64106940 2024-09-13T05:43:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.637+0000 7f7f6900d640 1 -- 172.21.15.79:0/1317549258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f64106dc0 con 0x7f7f64106940 2024-09-13T05:43:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.637+0000 7f7f4bfff640 1 --2- 172.21.15.79:0/1317549258 >> v2:172.21.15.79:6800/3535502969 conn(0x7f7f4c03f720 0x7f7f4c041be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.637+0000 7f7f4bfff640 1 -- 172.21.15.79:0/1317549258 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f7f54073e90 con 0x7f7f64106940 2024-09-13T05:43:01.838 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.637+0000 7f7f6259c640 1 --2- 172.21.15.79:0/1317549258 >> v2:172.21.15.79:6800/3535502969 conn(0x7f7f4c03f720 0x7f7f4c041be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:01.838 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.637+0000 7f7f6259c640 1 --2- 172.21.15.79:0/1317549258 >> v2:172.21.15.79:6800/3535502969 conn(0x7f7f4c03f720 0x7f7f4c041be0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7f580098c0 tx=0x7f7f58006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:01.838 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:00.641+0000 7f7f4bfff640 1 -- 172.21.15.79:0/1317549258 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f7f54077030 con 0x7f7f64106940 2024-09-13T05:43:01.838 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:01.025+0000 7f7f6900d640 1 -- 172.21.15.79:0/1317549258 --> v2:172.21.15.79:6800/3535502969 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f7f64103430 con 0x7f7f4c03f720 2024-09-13T05:43:01.838 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:01.029+0000 7f7f4bfff640 1 -- 172.21.15.79:0/1317549258 <== mgr.14118 v2:172.21.15.79:6800/3535502969 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7f64103430 con 0x7f7f4c03f720 2024-09-13T05:43:01.838 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:01.033+0000 7f7f6900d640 1 -- 172.21.15.79:0/1317549258 >> v2:172.21.15.79:6800/3535502969 conn(0x7f7f4c03f720 msgr2=0x7f7f4c041be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:01.838 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:01.033+0000 7f7f6900d640 1 --2- 172.21.15.79:0/1317549258 >> v2:172.21.15.79:6800/3535502969 conn(0x7f7f4c03f720 0x7f7f4c041be0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7f580098c0 tx=0x7f7f58006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:01.838 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:01.033+0000 7f7f6900d640 1 -- 172.21.15.79:0/1317549258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f64106940 msgr2=0x7f7f6419a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:01.838 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:01.033+0000 7f7f6900d640 1 --2- 172.21.15.79:0/1317549258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f64106940 0x7f7f6419a930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7f54006f10 tx=0x7f7f54030c10 comp rx=0 tx=0).stop 2024-09-13T05:43:01.838 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:01.033+0000 7f7f6900d640 1 -- 172.21.15.79:0/1317549258 shutdown_connections 2024-09-13T05:43:01.838 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:01.033+0000 7f7f6900d640 1 --2- 172.21.15.79:0/1317549258 >> v2:172.21.15.79:6800/3535502969 conn(0x7f7f4c03f720 0x7f7f4c041be0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:01.838 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:01.033+0000 7f7f6900d640 1 --2- 172.21.15.79:0/1317549258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f64106940 0x7f7f6419a930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:01.838 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:01.033+0000 7f7f6900d640 1 -- 172.21.15.79:0/1317549258 >> 172.21.15.79:0/1317549258 conn(0x7f7f641021d0 msgr2=0x7f7f64102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:01.838 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:01.033+0000 7f7f6900d640 1 -- 172.21.15.79:0/1317549258 shutdown_connections 2024-09-13T05:43:01.839 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:01.033+0000 7f7f6900d640 1 -- 172.21.15.79:0/1317549258 wait complete. 2024-09-13T05:43:01.839 INFO:teuthology.orchestra.run.smithi079.stdout:Deploying unmanaged mgr service... 2024-09-13T05:43:02.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:02 smithi079 bash[22814]: audit 2024-09-13T05:43:01.028275+0000 mgr.y (mgr.14118) 18 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:02.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:02 smithi079 bash[22814]: audit 2024-09-13T05:43:01.028275+0000 mgr.y (mgr.14118) 18 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:02.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:02 smithi079 bash[22814]: cephadm 2024-09-13T05:43:01.029523+0000 mgr.y (mgr.14118) 19 : cephadm [INF] Saving service mon spec with placement count:5 2024-09-13T05:43:02.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:02 smithi079 bash[22814]: cephadm 2024-09-13T05:43:01.029523+0000 mgr.y (mgr.14118) 19 : cephadm [INF] Saving service mon spec with placement count:5 2024-09-13T05:43:02.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:02 smithi079 bash[22814]: audit 2024-09-13T05:43:01.034517+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:43:02.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:02 smithi079 bash[22814]: audit 2024-09-13T05:43:01.034517+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:43:02.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:02 smithi079 bash[22814]: cluster 2024-09-13T05:43:01.739320+0000 mgr.y (mgr.14118) 20 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:02.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:02 smithi079 bash[22814]: cluster 2024-09-13T05:43:01.739320+0000 mgr.y (mgr.14118) 20 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:02.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:02 smithi079 bash[22814]: audit 2024-09-13T05:43:01.844426+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:43:02.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:02 smithi079 bash[22814]: audit 2024-09-13T05:43:01.844426+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:43:03.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:03 smithi079 bash[22814]: audit 2024-09-13T05:43:02.369051+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:43:03.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:03 smithi079 bash[22814]: audit 2024-09-13T05:43:02.369051+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:43:03.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:03 smithi079 bash[22814]: audit 2024-09-13T05:43:03.351789+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:43:03.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:03 smithi079 bash[22814]: audit 2024-09-13T05:43:03.351789+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:43:03.925 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T05:43:03.925 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f5954f90640 1 Processor -- start 2024-09-13T05:43:03.925 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f5954f90640 1 -- start start 2024-09-13T05:43:03.925 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f5954f90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595007ccc0 0x7f595007b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:03.925 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f5954f90640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f595007d170 con 0x7f595007ccc0 2024-09-13T05:43:03.925 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f594e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595007ccc0 0x7f595007b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:03.925 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f594e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595007ccc0 0x7f595007b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39058/0 (socket says 172.21.15.79:39058) 2024-09-13T05:43:03.925 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f594e59c640 1 -- 172.21.15.79:0/192570426 learned_addr learned my addr 172.21.15.79:0/192570426 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:03.925 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f594e59c640 1 -- 172.21.15.79:0/192570426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595007b860 con 0x7f595007ccc0 2024-09-13T05:43:03.925 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f594e59c640 1 --2- 172.21.15.79:0/192570426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595007ccc0 0x7f595007b320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5940009820 tx=0x7f594002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52496cfb5c00d68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f594d59a640 1 -- 172.21.15.79:0/192570426 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5940037070 con 0x7f595007ccc0 2024-09-13T05:43:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f594d59a640 1 -- 172.21.15.79:0/192570426 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f59400328c0 con 0x7f595007ccc0 2024-09-13T05:43:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f594d59a640 1 -- 172.21.15.79:0/192570426 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5940030640 con 0x7f595007ccc0 2024-09-13T05:43:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f5954f90640 1 -- 172.21.15.79:0/192570426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595007ccc0 msgr2=0x7f595007b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f5954f90640 1 --2- 172.21.15.79:0/192570426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595007ccc0 0x7f595007b320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5940009820 tx=0x7f594002a270 comp rx=0 tx=0).stop 2024-09-13T05:43:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f5954f90640 1 -- 172.21.15.79:0/192570426 shutdown_connections 2024-09-13T05:43:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f5954f90640 1 --2- 172.21.15.79:0/192570426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595007ccc0 0x7f595007b320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f5954f90640 1 -- 172.21.15.79:0/192570426 >> 172.21.15.79:0/192570426 conn(0x7f5950102250 msgr2=0x7f5950104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f5954f90640 1 -- 172.21.15.79:0/192570426 shutdown_connections 2024-09-13T05:43:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f5954f90640 1 -- 172.21.15.79:0/192570426 wait complete. 2024-09-13T05:43:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.965+0000 7f5954f90640 1 Processor -- start 2024-09-13T05:43:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f5954f90640 1 -- start start 2024-09-13T05:43:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f5954f90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595007ccc0 0x7f595019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f5954f90640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f595010cf10 con 0x7f595007ccc0 2024-09-13T05:43:03.927 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f594e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595007ccc0 0x7f595019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:03.927 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f594e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595007ccc0 0x7f595019ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39066/0 (socket says 172.21.15.79:39066) 2024-09-13T05:43:03.927 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f594e59c640 1 -- 172.21.15.79:0/2584428667 learned_addr learned my addr 172.21.15.79:0/2584428667 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:03.927 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f594e59c640 1 -- 172.21.15.79:0/2584428667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595019cfa0 con 0x7f595007ccc0 2024-09-13T05:43:03.927 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f594e59c640 1 --2- 172.21.15.79:0/2584428667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595007ccc0 0x7f595019ca40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f594002a830 tx=0x7f5940030bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:03.927 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f593f7fe640 1 -- 172.21.15.79:0/2584428667 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5940037040 con 0x7f595007ccc0 2024-09-13T05:43:03.927 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f593f7fe640 1 -- 172.21.15.79:0/2584428667 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f5940040070 con 0x7f595007ccc0 2024-09-13T05:43:03.927 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f5954f90640 1 -- 172.21.15.79:0/2584428667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595019d230 con 0x7f595007ccc0 2024-09-13T05:43:03.927 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f593f7fe640 1 -- 172.21.15.79:0/2584428667 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f594003be40 con 0x7f595007ccc0 2024-09-13T05:43:03.927 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f5954f90640 1 -- 172.21.15.79:0/2584428667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f595019dbf0 con 0x7f595007ccc0 2024-09-13T05:43:03.927 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f593f7fe640 1 -- 172.21.15.79:0/2584428667 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 9) ==== 51730+0+0 (secure 0 0 0) 0x7f594003b430 con 0x7f595007ccc0 2024-09-13T05:43:03.927 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f5954f90640 1 -- 172.21.15.79:0/2584428667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f595007b320 con 0x7f595007ccc0 2024-09-13T05:43:03.927 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f593f7fe640 1 --2- 172.21.15.79:0/2584428667 >> v2:172.21.15.79:6800/3535502969 conn(0x7f593803f720 0x7f5938041be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f593f7fe640 1 -- 172.21.15.79:0/2584428667 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f5940073e80 con 0x7f595007ccc0 2024-09-13T05:43:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f594dd9b640 1 --2- 172.21.15.79:0/2584428667 >> v2:172.21.15.79:6800/3535502969 conn(0x7f593803f720 0x7f5938041be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.969+0000 7f594dd9b640 1 --2- 172.21.15.79:0/2584428667 >> v2:172.21.15.79:6800/3535502969 conn(0x7f593803f720 0x7f5938041be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f59440098c0 tx=0x7f5944006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:02.973+0000 7f593f7fe640 1 -- 172.21.15.79:0/2584428667 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f5940030d50 con 0x7f595007ccc0 2024-09-13T05:43:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:03.341+0000 7f5954f90640 1 -- 172.21.15.79:0/2584428667 --> v2:172.21.15.79:6800/3535502969 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f595019e460 con 0x7f593803f720 2024-09-13T05:43:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:03.349+0000 7f593f7fe640 1 -- 172.21.15.79:0/2584428667 <== mgr.14118 v2:172.21.15.79:6800/3535502969 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f595019e460 con 0x7f593803f720 2024-09-13T05:43:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:03.353+0000 7f5954f90640 1 -- 172.21.15.79:0/2584428667 >> v2:172.21.15.79:6800/3535502969 conn(0x7f593803f720 msgr2=0x7f5938041be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:03.353+0000 7f5954f90640 1 --2- 172.21.15.79:0/2584428667 >> v2:172.21.15.79:6800/3535502969 conn(0x7f593803f720 0x7f5938041be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f59440098c0 tx=0x7f5944006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:03.353+0000 7f5954f90640 1 -- 172.21.15.79:0/2584428667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595007ccc0 msgr2=0x7f595019ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:03.353+0000 7f5954f90640 1 --2- 172.21.15.79:0/2584428667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595007ccc0 0x7f595019ca40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f594002a830 tx=0x7f5940030bc0 comp rx=0 tx=0).stop 2024-09-13T05:43:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:03.353+0000 7f5954f90640 1 -- 172.21.15.79:0/2584428667 shutdown_connections 2024-09-13T05:43:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:03.353+0000 7f5954f90640 1 --2- 172.21.15.79:0/2584428667 >> v2:172.21.15.79:6800/3535502969 conn(0x7f593803f720 0x7f5938041be0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:03.353+0000 7f5954f90640 1 --2- 172.21.15.79:0/2584428667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f595007ccc0 0x7f595019ca40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:03.929 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:03.353+0000 7f5954f90640 1 -- 172.21.15.79:0/2584428667 >> 172.21.15.79:0/2584428667 conn(0x7f5950102250 msgr2=0x7f5950102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:03.929 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:03.353+0000 7f5954f90640 1 -- 172.21.15.79:0/2584428667 shutdown_connections 2024-09-13T05:43:03.929 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:03.353+0000 7f5954f90640 1 -- 172.21.15.79:0/2584428667 wait complete. 2024-09-13T05:43:04.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:04 smithi079 bash[22814]: audit 2024-09-13T05:43:03.347669+0000 mgr.y (mgr.14118) 21 : audit [DBG] from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:04.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:04 smithi079 bash[22814]: audit 2024-09-13T05:43:03.347669+0000 mgr.y (mgr.14118) 21 : audit [DBG] from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:04.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:04 smithi079 bash[22814]: cephadm 2024-09-13T05:43:03.348613+0000 mgr.y (mgr.14118) 22 : cephadm [INF] Saving service mgr spec with placement count:2 2024-09-13T05:43:04.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:04 smithi079 bash[22814]: cephadm 2024-09-13T05:43:03.348613+0000 mgr.y (mgr.14118) 22 : cephadm [INF] Saving service mgr spec with placement count:2 2024-09-13T05:43:04.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:04 smithi079 bash[22814]: cluster 2024-09-13T05:43:03.739798+0000 mgr.y (mgr.14118) 23 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:04.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:04 smithi079 bash[22814]: cluster 2024-09-13T05:43:03.739798+0000 mgr.y (mgr.14118) 23 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.197+0000 7f470f7d6640 1 Processor -- start 2024-09-13T05:43:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.197+0000 7f470f7d6640 1 -- start start 2024-09-13T05:43:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.197+0000 7f470f7d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4708108b70 0x7f4708108f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.197+0000 7f470f7d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4708109560 con 0x7f4708108b70 2024-09-13T05:43:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.197+0000 7f470d572640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4708108b70 0x7f4708108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.197+0000 7f470d572640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4708108b70 0x7f4708108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39082/0 (socket says 172.21.15.79:39082) 2024-09-13T05:43:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.197+0000 7f470d572640 1 -- 172.21.15.79:0/2022473742 learned_addr learned my addr 172.21.15.79:0/2022473742 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.197+0000 7f470d572640 1 -- 172.21.15.79:0/2022473742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47081096e0 con 0x7f4708108b70 2024-09-13T05:43:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.197+0000 7f470d572640 1 --2- 172.21.15.79:0/2022473742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4708108b70 0x7f4708108f70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4704009820 tx=0x7f470402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c540035cc9b433 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.197+0000 7f46fffff640 1 -- 172.21.15.79:0/2022473742 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4704037070 con 0x7f4708108b70 2024-09-13T05:43:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.197+0000 7f46fffff640 1 -- 172.21.15.79:0/2022473742 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f47040328c0 con 0x7f4708108b70 2024-09-13T05:43:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.197+0000 7f46fffff640 1 -- 172.21.15.79:0/2022473742 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4704030640 con 0x7f4708108b70 2024-09-13T05:43:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470f7d6640 1 -- 172.21.15.79:0/2022473742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4708108b70 msgr2=0x7f4708108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470f7d6640 1 --2- 172.21.15.79:0/2022473742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4708108b70 0x7f4708108f70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4704009820 tx=0x7f470402a270 comp rx=0 tx=0).stop 2024-09-13T05:43:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470f7d6640 1 -- 172.21.15.79:0/2022473742 shutdown_connections 2024-09-13T05:43:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470f7d6640 1 --2- 172.21.15.79:0/2022473742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4708108b70 0x7f4708108f70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470f7d6640 1 -- 172.21.15.79:0/2022473742 >> 172.21.15.79:0/2022473742 conn(0x7f470807c350 msgr2=0x7f470807c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470f7d6640 1 -- 172.21.15.79:0/2022473742 shutdown_connections 2024-09-13T05:43:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470f7d6640 1 -- 172.21.15.79:0/2022473742 wait complete. 2024-09-13T05:43:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470f7d6640 1 Processor -- start 2024-09-13T05:43:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470f7d6640 1 -- start start 2024-09-13T05:43:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470f7d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4708108b70 0x7f470819ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470f7d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f470810cff0 con 0x7f4708108b70 2024-09-13T05:43:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470d572640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4708108b70 0x7f470819ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470d572640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4708108b70 0x7f470819ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39084/0 (socket says 172.21.15.79:39084) 2024-09-13T05:43:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470d572640 1 -- 172.21.15.79:0/355767711 learned_addr learned my addr 172.21.15.79:0/355767711 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470d572640 1 -- 172.21.15.79:0/355767711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470819cf90 con 0x7f4708108b70 2024-09-13T05:43:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470d572640 1 --2- 172.21.15.79:0/355767711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4708108b70 0x7f470819ca30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4704000c00 tx=0x7f4704030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f46fe7fc640 1 -- 172.21.15.79:0/355767711 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4704037040 con 0x7f4708108b70 2024-09-13T05:43:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f46fe7fc640 1 -- 172.21.15.79:0/355767711 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f4704040070 con 0x7f4708108b70 2024-09-13T05:43:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470f7d6640 1 -- 172.21.15.79:0/355767711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f470819d220 con 0x7f4708108b70 2024-09-13T05:43:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f46fe7fc640 1 -- 172.21.15.79:0/355767711 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f470403a390 con 0x7f4708108b70 2024-09-13T05:43:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470f7d6640 1 -- 172.21.15.79:0/355767711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f470819dbe0 con 0x7f4708108b70 2024-09-13T05:43:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f46fe7fc640 1 -- 172.21.15.79:0/355767711 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 9) ==== 51730+0+0 (secure 0 0 0) 0x7f470403b430 con 0x7f4708108b70 2024-09-13T05:43:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470f7d6640 1 -- 172.21.15.79:0/355767711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4708108f70 con 0x7f4708108b70 2024-09-13T05:43:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f46fe7fc640 1 --2- 172.21.15.79:0/355767711 >> v2:172.21.15.79:6800/3535502969 conn(0x7f46f403f720 0x7f46f4041be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f46fe7fc640 1 -- 172.21.15.79:0/355767711 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f4704073e90 con 0x7f4708108b70 2024-09-13T05:43:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.201+0000 7f470cd71640 1 --2- 172.21.15.79:0/355767711 >> v2:172.21.15.79:6800/3535502969 conn(0x7f46f403f720 0x7f46f4041be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.205+0000 7f470cd71640 1 --2- 172.21.15.79:0/355767711 >> v2:172.21.15.79:6800/3535502969 conn(0x7f46f403f720 0x7f46f4041be0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f46f80098c0 tx=0x7f46f8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.209+0000 7f46fe7fc640 1 -- 172.21.15.79:0/355767711 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f4704077030 con 0x7f4708108b70 2024-09-13T05:43:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.549+0000 7f470f7d6640 1 -- 172.21.15.79:0/355767711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f470819e320 con 0x7f4708108b70 2024-09-13T05:43:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.553+0000 7f46fe7fc640 1 -- 172.21.15.79:0/355767711 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f4704073bf0 con 0x7f4708108b70 2024-09-13T05:43:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.557+0000 7f470f7d6640 1 -- 172.21.15.79:0/355767711 >> v2:172.21.15.79:6800/3535502969 conn(0x7f46f403f720 msgr2=0x7f46f4041be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.557+0000 7f470f7d6640 1 --2- 172.21.15.79:0/355767711 >> v2:172.21.15.79:6800/3535502969 conn(0x7f46f403f720 0x7f46f4041be0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f46f80098c0 tx=0x7f46f8006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.557+0000 7f470f7d6640 1 -- 172.21.15.79:0/355767711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4708108b70 msgr2=0x7f470819ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.557+0000 7f470f7d6640 1 --2- 172.21.15.79:0/355767711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4708108b70 0x7f470819ca30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4704000c00 tx=0x7f4704030b70 comp rx=0 tx=0).stop 2024-09-13T05:43:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.557+0000 7f470f7d6640 1 -- 172.21.15.79:0/355767711 shutdown_connections 2024-09-13T05:43:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.557+0000 7f470f7d6640 1 --2- 172.21.15.79:0/355767711 >> v2:172.21.15.79:6800/3535502969 conn(0x7f46f403f720 0x7f46f4041be0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.557+0000 7f470f7d6640 1 --2- 172.21.15.79:0/355767711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4708108b70 0x7f470819ca30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.557+0000 7f470f7d6640 1 -- 172.21.15.79:0/355767711 >> 172.21.15.79:0/355767711 conn(0x7f470807c350 msgr2=0x7f4708106640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.557+0000 7f470f7d6640 1 -- 172.21.15.79:0/355767711 shutdown_connections 2024-09-13T05:43:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:05.557+0000 7f470f7d6640 1 -- 172.21.15.79:0/355767711 wait complete. 2024-09-13T05:43:06.987 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:06 smithi079 bash[22814]: audit 2024-09-13T05:43:05.558024+0000 mon.a (mon.0) 70 : audit [INF] from='client.? 172.21.15.79:0/355767711' entity='client.admin' 2024-09-13T05:43:06.987 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:06 smithi079 bash[22814]: audit 2024-09-13T05:43:05.558024+0000 mon.a (mon.0) 70 : audit [INF] from='client.? 172.21.15.79:0/355767711' entity='client.admin' 2024-09-13T05:43:06.987 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:06 smithi079 bash[22814]: cluster 2024-09-13T05:43:05.740197+0000 mgr.y (mgr.14118) 24 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:06.987 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:06 smithi079 bash[22814]: cluster 2024-09-13T05:43:05.740197+0000 mgr.y (mgr.14118) 24 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:08.173 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721c440640 1 Processor -- start 2024-09-13T05:43:08.173 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721c440640 1 -- start start 2024-09-13T05:43:08.173 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721c440640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7214105de0 0x7f72141061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:08.173 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721c440640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7214106720 con 0x7f7214105de0 2024-09-13T05:43:08.173 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721a1dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7214105de0 0x7f72141061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:08.173 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721a1dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7214105de0 0x7f72141061e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39088/0 (socket says 172.21.15.79:39088) 2024-09-13T05:43:08.173 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721a1dc640 1 -- 172.21.15.79:0/1251652850 learned_addr learned my addr 172.21.15.79:0/1251652850 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:08.173 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721a1dc640 1 -- 172.21.15.79:0/1251652850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72141068a0 con 0x7f7214105de0 2024-09-13T05:43:08.174 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721a1dc640 1 --2- 172.21.15.79:0/1251652850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7214105de0 0x7f72141061e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7210009820 tx=0x7f721002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ba709eb78908ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:08.174 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f72191da640 1 -- 172.21.15.79:0/1251652850 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7210037070 con 0x7f7214105de0 2024-09-13T05:43:08.174 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f72191da640 1 -- 172.21.15.79:0/1251652850 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f72100328c0 con 0x7f7214105de0 2024-09-13T05:43:08.174 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f72191da640 1 -- 172.21.15.79:0/1251652850 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7210030640 con 0x7f7214105de0 2024-09-13T05:43:08.174 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721c440640 1 -- 172.21.15.79:0/1251652850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7214105de0 msgr2=0x7f72141061e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:08.174 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721c440640 1 --2- 172.21.15.79:0/1251652850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7214105de0 0x7f72141061e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7210009820 tx=0x7f721002a270 comp rx=0 tx=0).stop 2024-09-13T05:43:08.174 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721c440640 1 -- 172.21.15.79:0/1251652850 shutdown_connections 2024-09-13T05:43:08.174 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721c440640 1 --2- 172.21.15.79:0/1251652850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7214105de0 0x7f72141061e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:08.174 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721c440640 1 -- 172.21.15.79:0/1251652850 >> 172.21.15.79:0/1251652850 conn(0x7f7214100860 msgr2=0x7f7214102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:08.174 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721c440640 1 -- 172.21.15.79:0/1251652850 shutdown_connections 2024-09-13T05:43:08.174 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.176+0000 7f721c440640 1 -- 172.21.15.79:0/1251652850 wait complete. 2024-09-13T05:43:08.174 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f721c440640 1 Processor -- start 2024-09-13T05:43:08.174 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f721c440640 1 -- start start 2024-09-13T05:43:08.175 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f721c440640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7214105de0 0x7f721419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:08.175 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f721c440640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f72141079a0 con 0x7f7214105de0 2024-09-13T05:43:08.175 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f721a1dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7214105de0 0x7f721419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:08.175 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f721a1dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7214105de0 0x7f721419a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39100/0 (socket says 172.21.15.79:39100) 2024-09-13T05:43:08.175 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f721a1dc640 1 -- 172.21.15.79:0/2625416841 learned_addr learned my addr 172.21.15.79:0/2625416841 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:08.175 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f721a1dc640 1 -- 172.21.15.79:0/2625416841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721419ae20 con 0x7f7214105de0 2024-09-13T05:43:08.175 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f721a1dc640 1 --2- 172.21.15.79:0/2625416841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7214105de0 0x7f721419a8c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f721002a830 tx=0x7f7210030bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:08.175 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f720b7fe640 1 -- 172.21.15.79:0/2625416841 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7210037040 con 0x7f7214105de0 2024-09-13T05:43:08.175 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f720b7fe640 1 -- 172.21.15.79:0/2625416841 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f7210040070 con 0x7f7214105de0 2024-09-13T05:43:08.175 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f720b7fe640 1 -- 172.21.15.79:0/2625416841 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f721003be10 con 0x7f7214105de0 2024-09-13T05:43:08.175 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f721c440640 1 -- 172.21.15.79:0/2625416841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f721419b0b0 con 0x7f7214105de0 2024-09-13T05:43:08.175 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f721c440640 1 -- 172.21.15.79:0/2625416841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f721419ba70 con 0x7f7214105de0 2024-09-13T05:43:08.176 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f720b7fe640 1 -- 172.21.15.79:0/2625416841 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 9) ==== 51730+0+0 (secure 0 0 0) 0x7f721003b430 con 0x7f7214105de0 2024-09-13T05:43:08.176 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f72097fa640 1 -- 172.21.15.79:0/2625416841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71fc005080 con 0x7f7214105de0 2024-09-13T05:43:08.176 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f720b7fe640 1 --2- 172.21.15.79:0/2625416841 >> v2:172.21.15.79:6800/3535502969 conn(0x7f720003f680 0x7f7200041b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:08.176 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f720b7fe640 1 -- 172.21.15.79:0/2625416841 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f72100742e0 con 0x7f7214105de0 2024-09-13T05:43:08.176 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f72199db640 1 --2- 172.21.15.79:0/2625416841 >> v2:172.21.15.79:6800/3535502969 conn(0x7f720003f680 0x7f7200041b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:08.176 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.180+0000 7f72199db640 1 --2- 172.21.15.79:0/2625416841 >> v2:172.21.15.79:6800/3535502969 conn(0x7f720003f680 0x7f7200041b40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f72040098c0 tx=0x7f7204006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:08.176 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.184+0000 7f720b7fe640 1 -- 172.21.15.79:0/2625416841 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f7210043360 con 0x7f7214105de0 2024-09-13T05:43:08.176 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.520+0000 7f72097fa640 1 -- 172.21.15.79:0/2625416841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f71fc005370 con 0x7f7214105de0 2024-09-13T05:43:08.176 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.524+0000 7f720b7fe640 1 -- 172.21.15.79:0/2625416841 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f7210030d50 con 0x7f7214105de0 2024-09-13T05:43:08.176 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.528+0000 7f72097fa640 1 -- 172.21.15.79:0/2625416841 >> v2:172.21.15.79:6800/3535502969 conn(0x7f720003f680 msgr2=0x7f7200041b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:08.177 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.528+0000 7f72097fa640 1 --2- 172.21.15.79:0/2625416841 >> v2:172.21.15.79:6800/3535502969 conn(0x7f720003f680 0x7f7200041b40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f72040098c0 tx=0x7f7204006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:08.177 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.528+0000 7f72097fa640 1 -- 172.21.15.79:0/2625416841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7214105de0 msgr2=0x7f721419a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:08.177 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.528+0000 7f72097fa640 1 --2- 172.21.15.79:0/2625416841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7214105de0 0x7f721419a8c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f721002a830 tx=0x7f7210030bc0 comp rx=0 tx=0).stop 2024-09-13T05:43:08.177 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.528+0000 7f72097fa640 1 -- 172.21.15.79:0/2625416841 shutdown_connections 2024-09-13T05:43:08.177 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.528+0000 7f72097fa640 1 --2- 172.21.15.79:0/2625416841 >> v2:172.21.15.79:6800/3535502969 conn(0x7f720003f680 0x7f7200041b40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:08.177 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.528+0000 7f72097fa640 1 --2- 172.21.15.79:0/2625416841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7214105de0 0x7f721419a8c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:08.177 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.528+0000 7f72097fa640 1 -- 172.21.15.79:0/2625416841 >> 172.21.15.79:0/2625416841 conn(0x7f7214100860 msgr2=0x7f7214104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:08.177 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.528+0000 7f72097fa640 1 -- 172.21.15.79:0/2625416841 shutdown_connections 2024-09-13T05:43:08.177 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:07.528+0000 7f72097fa640 1 -- 172.21.15.79:0/2625416841 wait complete. 2024-09-13T05:43:08.177 INFO:teuthology.orchestra.run.smithi079.stdout:Enabling the dashboard module... 2024-09-13T05:43:08.987 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:08 smithi079 bash[22814]: audit 2024-09-13T05:43:07.528752+0000 mon.a (mon.0) 71 : audit [INF] from='client.? 172.21.15.79:0/2625416841' entity='client.admin' 2024-09-13T05:43:08.987 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:08 smithi079 bash[22814]: audit 2024-09-13T05:43:07.528752+0000 mon.a (mon.0) 71 : audit [INF] from='client.? 172.21.15.79:0/2625416841' entity='client.admin' 2024-09-13T05:43:08.987 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:08 smithi079 bash[22814]: cluster 2024-09-13T05:43:07.740580+0000 mgr.y (mgr.14118) 25 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:08.987 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:08 smithi079 bash[22814]: cluster 2024-09-13T05:43:07.740580+0000 mgr.y (mgr.14118) 25 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:10.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:09 smithi079 bash[22814]: audit 2024-09-13T05:43:08.832629+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:43:10.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:09 smithi079 bash[22814]: audit 2024-09-13T05:43:08.832629+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:43:10.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:09 smithi079 bash[22814]: cluster 2024-09-13T05:43:09.740962+0000 mgr.y (mgr.14118) 26 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:10.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:09 smithi079 bash[22814]: cluster 2024-09-13T05:43:09.740962+0000 mgr.y (mgr.14118) 26 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:11.237 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:10 smithi079 bash[23069]: ignoring --setuser ceph since I am not root 2024-09-13T05:43:11.237 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:10 smithi079 bash[23069]: ignoring --setgroup ceph since I am not root 2024-09-13T05:43:11.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:10 smithi079 bash[22814]: audit 2024-09-13T05:43:09.835598+0000 mon.a (mon.0) 73 : audit [INF] from='client.? 172.21.15.79:0/709676584' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-13T05:43:11.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:10 smithi079 bash[22814]: audit 2024-09-13T05:43:09.835598+0000 mon.a (mon.0) 73 : audit [INF] from='client.? 172.21.15.79:0/709676584' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-13T05:43:11.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:10 smithi079 bash[22814]: audit 2024-09-13T05:43:09.963271+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:43:11.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:10 smithi079 bash[22814]: audit 2024-09-13T05:43:09.963271+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.14118 172.21.15.79:0/4153359920' entity='mgr.y' 2024-09-13T05:43:11.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:10 smithi079 bash[22814]: audit 2024-09-13T05:43:10.833181+0000 mon.a (mon.0) 75 : audit [INF] from='client.? 172.21.15.79:0/709676584' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T05:43:11.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:10 smithi079 bash[22814]: audit 2024-09-13T05:43:10.833181+0000 mon.a (mon.0) 75 : audit [INF] from='client.? 172.21.15.79:0/709676584' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T05:43:11.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:10 smithi079 bash[22814]: cluster 2024-09-13T05:43:10.840443+0000 mon.a (mon.0) 76 : cluster [DBG] mgrmap e10: y(active, since 31s) 2024-09-13T05:43:11.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:10 smithi079 bash[22814]: cluster 2024-09-13T05:43:10.840443+0000 mon.a (mon.0) 76 : cluster [DBG] mgrmap e10: y(active, since 31s) 2024-09-13T05:43:11.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.356+0000 7f6493919640 1 Processor -- start 2024-09-13T05:43:11.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.356+0000 7f6493919640 1 -- start start 2024-09-13T05:43:11.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.356+0000 7f6493919640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f648c105860 0x7f648c105c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:11.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.356+0000 7f6493919640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f648c106250 con 0x7f648c105860 2024-09-13T05:43:11.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.356+0000 7f64916b5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f648c105860 0x7f648c105c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:11.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.356+0000 7f64916b5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f648c105860 0x7f648c105c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39104/0 (socket says 172.21.15.79:39104) 2024-09-13T05:43:11.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.356+0000 7f64916b5640 1 -- 172.21.15.79:0/1660567505 learned_addr learned my addr 172.21.15.79:0/1660567505 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.356+0000 7f64916b5640 1 -- 172.21.15.79:0/1660567505 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c1063d0 con 0x7f648c105860 2024-09-13T05:43:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f64916b5640 1 --2- 172.21.15.79:0/1660567505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f648c105860 0x7f648c105c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f648800bac0 tx=0x7f648802c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6e79926c27e845 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6483fff640 1 -- 172.21.15.79:0/1660567505 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64880326d0 con 0x7f648c105860 2024-09-13T05:43:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6483fff640 1 -- 172.21.15.79:0/1660567505 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f6488038070 con 0x7f648c105860 2024-09-13T05:43:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6483fff640 1 -- 172.21.15.79:0/1660567505 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6488033b30 con 0x7f648c105860 2024-09-13T05:43:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6493919640 1 -- 172.21.15.79:0/1660567505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f648c105860 msgr2=0x7f648c105c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6493919640 1 --2- 172.21.15.79:0/1660567505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f648c105860 0x7f648c105c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f648800bac0 tx=0x7f648802c920 comp rx=0 tx=0).stop 2024-09-13T05:43:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6493919640 1 -- 172.21.15.79:0/1660567505 shutdown_connections 2024-09-13T05:43:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6493919640 1 --2- 172.21.15.79:0/1660567505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f648c105860 0x7f648c105c60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6493919640 1 -- 172.21.15.79:0/1660567505 >> 172.21.15.79:0/1660567505 conn(0x7f648c1011b0 msgr2=0x7f648c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6493919640 1 -- 172.21.15.79:0/1660567505 shutdown_connections 2024-09-13T05:43:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6493919640 1 -- 172.21.15.79:0/1660567505 wait complete. 2024-09-13T05:43:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6493919640 1 Processor -- start 2024-09-13T05:43:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6493919640 1 -- start start 2024-09-13T05:43:11.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6493919640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f648c105860 0x7f648c19cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:11.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6493919640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f648c0797f0 con 0x7f648c105860 2024-09-13T05:43:11.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f64916b5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f648c105860 0x7f648c19cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:11.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f64916b5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f648c105860 0x7f648c19cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39108/0 (socket says 172.21.15.79:39108) 2024-09-13T05:43:11.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f64916b5640 1 -- 172.21.15.79:0/709676584 learned_addr learned my addr 172.21.15.79:0/709676584 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:11.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f64916b5640 1 -- 172.21.15.79:0/709676584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c19d0c0 con 0x7f648c105860 2024-09-13T05:43:11.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f64916b5640 1 --2- 172.21.15.79:0/709676584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f648c105860 0x7f648c19cb60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6488032b40 tx=0x7f6488032b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:11.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f64827fc640 1 -- 172.21.15.79:0/709676584 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6488042070 con 0x7f648c105860 2024-09-13T05:43:11.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f64827fc640 1 -- 172.21.15.79:0/709676584 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f648803eb90 con 0x7f648c105860 2024-09-13T05:43:11.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6493919640 1 -- 172.21.15.79:0/709676584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648c19d350 con 0x7f648c105860 2024-09-13T05:43:11.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f64827fc640 1 -- 172.21.15.79:0/709676584 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f648803ca60 con 0x7f648c105860 2024-09-13T05:43:11.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f6493919640 1 -- 172.21.15.79:0/709676584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648c19dd90 con 0x7f648c105860 2024-09-13T05:43:11.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.360+0000 7f64827fc640 1 -- 172.21.15.79:0/709676584 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 9) ==== 51730+0+0 (secure 0 0 0) 0x7f6488045070 con 0x7f648c105860 2024-09-13T05:43:11.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.364+0000 7f6493919640 1 -- 172.21.15.79:0/709676584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f648c105c60 con 0x7f648c105860 2024-09-13T05:43:11.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.364+0000 7f64827fc640 1 --2- 172.21.15.79:0/709676584 >> v2:172.21.15.79:6800/3535502969 conn(0x7f647803f6d0 0x7f6478041b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:11.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.364+0000 7f64827fc640 1 -- 172.21.15.79:0/709676584 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f6488030050 con 0x7f648c105860 2024-09-13T05:43:11.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.364+0000 7f6490eb4640 1 --2- 172.21.15.79:0/709676584 >> v2:172.21.15.79:6800/3535502969 conn(0x7f647803f6d0 0x7f6478041b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:11.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.364+0000 7f6490eb4640 1 --2- 172.21.15.79:0/709676584 >> v2:172.21.15.79:6800/3535502969 conn(0x7f647803f6d0 0x7f6478041b90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f647c0098c0 tx=0x7f647c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:11.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.368+0000 7f64827fc640 1 -- 172.21.15.79:0/709676584 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f6488045360 con 0x7f648c105860 2024-09-13T05:43:11.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:09.832+0000 7f6493919640 1 -- 172.21.15.79:0/709676584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f648c195e70 con 0x7f648c105860 2024-09-13T05:43:11.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:10.828+0000 7f64827fc640 1 -- 172.21.15.79:0/709676584 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v10) ==== 88+0+0 (secure 0 0 0) 0x7f648803cd60 con 0x7f648c105860 2024-09-13T05:43:11.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:10.832+0000 7f6493919640 1 -- 172.21.15.79:0/709676584 >> v2:172.21.15.79:6800/3535502969 conn(0x7f647803f6d0 msgr2=0x7f6478041b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:11.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:10.832+0000 7f6493919640 1 --2- 172.21.15.79:0/709676584 >> v2:172.21.15.79:6800/3535502969 conn(0x7f647803f6d0 0x7f6478041b90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f647c0098c0 tx=0x7f647c006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:11.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:10.832+0000 7f6493919640 1 -- 172.21.15.79:0/709676584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f648c105860 msgr2=0x7f648c19cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:11.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:10.832+0000 7f64827fc640 1 -- 172.21.15.79:0/709676584 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mgrmap(e 10) ==== 51743+0+0 (secure 0 0 0) 0x7f648803b8d0 con 0x7f648c105860 2024-09-13T05:43:11.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:10.832+0000 7f6493919640 1 --2- 172.21.15.79:0/709676584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f648c105860 0x7f648c19cb60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6488032b40 tx=0x7f6488032b70 comp rx=0 tx=0).stop 2024-09-13T05:43:11.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:10.832+0000 7f6493919640 1 -- 172.21.15.79:0/709676584 shutdown_connections 2024-09-13T05:43:11.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:10.832+0000 7f6493919640 1 --2- 172.21.15.79:0/709676584 >> v2:172.21.15.79:6800/3535502969 conn(0x7f647803f6d0 0x7f6478041b90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:11.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:10.832+0000 7f6493919640 1 --2- 172.21.15.79:0/709676584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f648c105860 0x7f648c19cb60 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6488032b40 tx=0x7f6488032b70 comp rx=0 tx=0).stop 2024-09-13T05:43:11.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:10.832+0000 7f6493919640 1 -- 172.21.15.79:0/709676584 >> 172.21.15.79:0/709676584 conn(0x7f648c1011b0 msgr2=0x7f648c192fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:11.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:10.832+0000 7f64827fc640 1 --2- 172.21.15.79:0/709676584 >> v2:172.21.15.79:6800/3535502969 conn(0x7f647803fb80 0x7f6478043330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:11.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:10.832+0000 7f6493919640 1 -- 172.21.15.79:0/709676584 shutdown_connections 2024-09-13T05:43:11.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:10.832+0000 7f6493919640 1 --2- 172.21.15.79:0/709676584 >> v2:172.21.15.79:6800/3535502969 conn(0x7f647803fb80 0x7f6478043330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:11.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:10.832+0000 7f6493919640 1 -- 172.21.15.79:0/709676584 wait complete. 2024-09-13T05:43:13.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:13 smithi079 bash[22814]: audit 2024-09-13T05:43:13.107580+0000 mon.a (mon.0) 77 : audit [DBG] from='client.? 172.21.15.79:0/2751582994' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-13T05:43:13.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:13 smithi079 bash[22814]: audit 2024-09-13T05:43:13.107580+0000 mon.a (mon.0) 77 : audit [DBG] from='client.? 172.21.15.79:0/2751582994' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-13T05:43:13.673 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-13T05:43:13.673 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 10, 2024-09-13T05:43:13.673 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T05:43:13.673 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-13T05:43:13.673 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T05:43:13.673 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-13T05:43:13.673 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.652+0000 7f07ceb30640 1 Processor -- start 2024-09-13T05:43:13.673 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.652+0000 7f07ceb30640 1 -- start start 2024-09-13T05:43:13.673 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07ceb30640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c807a3c0 0x7f07c81095a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:13.673 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07ceb30640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07c8109ae0 con 0x7f07c807a3c0 2024-09-13T05:43:13.674 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07cc8cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c807a3c0 0x7f07c81095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:13.674 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07cc8cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c807a3c0 0x7f07c81095a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39128/0 (socket says 172.21.15.79:39128) 2024-09-13T05:43:13.674 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07cc8cc640 1 -- 172.21.15.79:0/253280639 learned_addr learned my addr 172.21.15.79:0/253280639 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:13.674 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07cc8cc640 1 -- 172.21.15.79:0/253280639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c8109c60 con 0x7f07c807a3c0 2024-09-13T05:43:13.674 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07cc8cc640 1 --2- 172.21.15.79:0/253280639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c807a3c0 0x7f07c81095a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009820 tx=0x7f07bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cd72e91932c82b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:13.674 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07c77fe640 1 -- 172.21.15.79:0/253280639 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07bc037070 con 0x7f07c807a3c0 2024-09-13T05:43:13.674 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07c77fe640 1 -- 172.21.15.79:0/253280639 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f07bc0328c0 con 0x7f07c807a3c0 2024-09-13T05:43:13.674 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07c77fe640 1 -- 172.21.15.79:0/253280639 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07bc030640 con 0x7f07c807a3c0 2024-09-13T05:43:13.674 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07ceb30640 1 -- 172.21.15.79:0/253280639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c807a3c0 msgr2=0x7f07c81095a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:13.674 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07ceb30640 1 --2- 172.21.15.79:0/253280639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c807a3c0 0x7f07c81095a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009820 tx=0x7f07bc02a270 comp rx=0 tx=0).stop 2024-09-13T05:43:13.674 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07ceb30640 1 -- 172.21.15.79:0/253280639 shutdown_connections 2024-09-13T05:43:13.674 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07ceb30640 1 --2- 172.21.15.79:0/253280639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c807a3c0 0x7f07c81095a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:13.674 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07ceb30640 1 -- 172.21.15.79:0/253280639 >> 172.21.15.79:0/253280639 conn(0x7f07c81011b0 msgr2=0x7f07c81035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07ceb30640 1 -- 172.21.15.79:0/253280639 shutdown_connections 2024-09-13T05:43:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07ceb30640 1 -- 172.21.15.79:0/253280639 wait complete. 2024-09-13T05:43:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07ceb30640 1 Processor -- start 2024-09-13T05:43:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07ceb30640 1 -- start start 2024-09-13T05:43:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07ceb30640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c807a3c0 0x7f07c8106bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07ceb30640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07c810ad00 con 0x7f07c807a3c0 2024-09-13T05:43:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07cc8cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c807a3c0 0x7f07c8106bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07cc8cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c807a3c0 0x7f07c8106bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39134/0 (socket says 172.21.15.79:39134) 2024-09-13T05:43:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.656+0000 7f07cc8cc640 1 -- 172.21.15.79:0/2751582994 learned_addr learned my addr 172.21.15.79:0/2751582994 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.660+0000 7f07cc8cc640 1 -- 172.21.15.79:0/2751582994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c8107150 con 0x7f07c807a3c0 2024-09-13T05:43:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.660+0000 7f07cc8cc640 1 --2- 172.21.15.79:0/2751582994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c807a3c0 0x7f07c8106bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f07bc02a830 tx=0x7f07bc030bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.660+0000 7f07c5ffb640 1 -- 172.21.15.79:0/2751582994 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07bc037040 con 0x7f07c807a3c0 2024-09-13T05:43:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.660+0000 7f07c5ffb640 1 -- 172.21.15.79:0/2751582994 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f07bc040070 con 0x7f07c807a3c0 2024-09-13T05:43:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.660+0000 7f07ceb30640 1 -- 172.21.15.79:0/2751582994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c8105540 con 0x7f07c807a3c0 2024-09-13T05:43:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.660+0000 7f07c5ffb640 1 -- 172.21.15.79:0/2751582994 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07bc03be40 con 0x7f07c807a3c0 2024-09-13T05:43:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.660+0000 7f07ceb30640 1 -- 172.21.15.79:0/2751582994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c8105ac0 con 0x7f07c807a3c0 2024-09-13T05:43:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.660+0000 7f07b37fe640 1 -- 172.21.15.79:0/2751582994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a8005080 con 0x7f07c807a3c0 2024-09-13T05:43:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.660+0000 7f07c5ffb640 1 -- 172.21.15.79:0/2751582994 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 10) ==== 51743+0+0 (secure 0 0 0) 0x7f07bc03b430 con 0x7f07c807a3c0 2024-09-13T05:43:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.660+0000 7f07c5ffb640 1 --2- 172.21.15.79:0/2751582994 >> v2:172.21.15.79:6800/3535502969 conn(0x7f07b803f720 0x7f07b8041be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.660+0000 7f07c5ffb640 1 -- 172.21.15.79:0/2751582994 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f07bc073f00 con 0x7f07c807a3c0 2024-09-13T05:43:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.660+0000 7f07c7fff640 1 -- 172.21.15.79:0/2751582994 >> v2:172.21.15.79:6800/3535502969 conn(0x7f07b803f720 msgr2=0x7f07b8041be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/3535502969 2024-09-13T05:43:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.660+0000 7f07c7fff640 1 --2- 172.21.15.79:0/2751582994 >> v2:172.21.15.79:6800/3535502969 conn(0x7f07b803f720 0x7f07b8041be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T05:43:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.664+0000 7f07c5ffb640 1 -- 172.21.15.79:0/2751582994 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f07bc03ae50 con 0x7f07c807a3c0 2024-09-13T05:43:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.864+0000 7f07c7fff640 1 -- 172.21.15.79:0/2751582994 >> v2:172.21.15.79:6800/3535502969 conn(0x7f07b803f720 msgr2=0x7f07b8041be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/3535502969 2024-09-13T05:43:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:12.864+0000 7f07c7fff640 1 --2- 172.21.15.79:0/2751582994 >> v2:172.21.15.79:6800/3535502969 conn(0x7f07b803f720 0x7f07b8041be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T05:43:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:13.104+0000 7f07b37fe640 1 -- 172.21.15.79:0/2751582994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f07a8005b80 con 0x7f07c807a3c0 2024-09-13T05:43:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:13.104+0000 7f07c5ffb640 1 -- 172.21.15.79:0/2751582994 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v10) ==== 56+0+89 (secure 0 0 0) 0x7f07bc030d50 con 0x7f07c807a3c0 2024-09-13T05:43:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:13.108+0000 7f07b37fe640 1 -- 172.21.15.79:0/2751582994 >> v2:172.21.15.79:6800/3535502969 conn(0x7f07b803f720 msgr2=0x7f07b8041be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T05:43:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:13.108+0000 7f07b37fe640 1 --2- 172.21.15.79:0/2751582994 >> v2:172.21.15.79:6800/3535502969 conn(0x7f07b803f720 0x7f07b8041be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:13.108+0000 7f07b37fe640 1 -- 172.21.15.79:0/2751582994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c807a3c0 msgr2=0x7f07c8106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:13.108+0000 7f07b37fe640 1 --2- 172.21.15.79:0/2751582994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c807a3c0 0x7f07c8106bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f07bc02a830 tx=0x7f07bc030bc0 comp rx=0 tx=0).stop 2024-09-13T05:43:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:13.108+0000 7f07b37fe640 1 -- 172.21.15.79:0/2751582994 shutdown_connections 2024-09-13T05:43:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:13.108+0000 7f07b37fe640 1 --2- 172.21.15.79:0/2751582994 >> v2:172.21.15.79:6800/3535502969 conn(0x7f07b803f720 0x7f07b8041be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:13.108+0000 7f07b37fe640 1 --2- 172.21.15.79:0/2751582994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c807a3c0 0x7f07c8106bf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:13.108+0000 7f07b37fe640 1 -- 172.21.15.79:0/2751582994 >> 172.21.15.79:0/2751582994 conn(0x7f07c81011b0 msgr2=0x7f07c8101bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:13.108+0000 7f07b37fe640 1 -- 172.21.15.79:0/2751582994 shutdown_connections 2024-09-13T05:43:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:13.108+0000 7f07b37fe640 1 -- 172.21.15.79:0/2751582994 wait complete. 2024-09-13T05:43:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for the mgr to restart... 2024-09-13T05:43:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr epoch 10... 2024-09-13T05:43:17.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: cluster 2024-09-13T05:43:16.891695+0000 mon.a (mon.0) 78 : cluster [INF] Active manager daemon y restarted 2024-09-13T05:43:17.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: cluster 2024-09-13T05:43:16.891695+0000 mon.a (mon.0) 78 : cluster [INF] Active manager daemon y restarted 2024-09-13T05:43:17.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: cluster 2024-09-13T05:43:16.892204+0000 mon.a (mon.0) 79 : cluster [INF] Activating manager daemon y 2024-09-13T05:43:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: cluster 2024-09-13T05:43:16.892204+0000 mon.a (mon.0) 79 : cluster [INF] Activating manager daemon y 2024-09-13T05:43:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: cluster 2024-09-13T05:43:16.899247+0000 mon.a (mon.0) 80 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-09-13T05:43:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: cluster 2024-09-13T05:43:16.899247+0000 mon.a (mon.0) 80 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-09-13T05:43:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: cluster 2024-09-13T05:43:16.899493+0000 mon.a (mon.0) 81 : cluster [DBG] mgrmap e11: y(active, starting, since 0.00750037s) 2024-09-13T05:43:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: cluster 2024-09-13T05:43:16.899493+0000 mon.a (mon.0) 81 : cluster [DBG] mgrmap e11: y(active, starting, since 0.00750037s) 2024-09-13T05:43:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: audit 2024-09-13T05:43:16.900747+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:43:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: audit 2024-09-13T05:43:16.900747+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:43:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: audit 2024-09-13T05:43:16.902515+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-13T05:43:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: audit 2024-09-13T05:43:16.902515+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-13T05:43:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: audit 2024-09-13T05:43:16.903662+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-13T05:43:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: audit 2024-09-13T05:43:16.903662+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-13T05:43:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: audit 2024-09-13T05:43:16.903776+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-13T05:43:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: audit 2024-09-13T05:43:16.903776+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-13T05:43:17.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: audit 2024-09-13T05:43:16.903904+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-13T05:43:17.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: audit 2024-09-13T05:43:16.903904+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-13T05:43:17.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: cluster 2024-09-13T05:43:16.929545+0000 mon.a (mon.0) 87 : cluster [INF] Manager daemon y is now available 2024-09-13T05:43:17.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:16 smithi079 bash[22814]: cluster 2024-09-13T05:43:16.929545+0000 mon.a (mon.0) 87 : cluster [INF] Manager daemon y is now available 2024-09-13T05:43:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:17 smithi079 bash[22814]: audit 2024-09-13T05:43:17.185651+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:43:18.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:17 smithi079 bash[22814]: audit 2024-09-13T05:43:17.185651+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:43:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:17 smithi079 bash[22814]: audit 2024-09-13T05:43:17.199528+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-13T05:43:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:17 smithi079 bash[22814]: audit 2024-09-13T05:43:17.199528+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-13T05:43:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:17 smithi079 bash[22814]: audit 2024-09-13T05:43:17.201409+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-13T05:43:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:17 smithi079 bash[22814]: audit 2024-09-13T05:43:17.201409+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-13T05:43:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:17 smithi079 bash[22814]: audit 2024-09-13T05:43:17.898758+0000 mgr.y (mgr.14152) 1 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T05:43:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:17 smithi079 bash[22814]: audit 2024-09-13T05:43:17.898758+0000 mgr.y (mgr.14152) 1 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T05:43:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:17 smithi079 bash[22814]: cluster 2024-09-13T05:43:17.899574+0000 mon.a (mon.0) 91 : cluster [DBG] mgrmap e12: y(active, since 1.00758s) 2024-09-13T05:43:18.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:17 smithi079 bash[22814]: cluster 2024-09-13T05:43:17.899574+0000 mon.a (mon.0) 91 : cluster [DBG] mgrmap e12: y(active, since 1.00758s) 2024-09-13T05:43:18.603 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-13T05:43:18.603 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 12, 2024-09-13T05:43:18.603 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T05:43:18.603 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-13T05:43:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 Processor -- start 2024-09-13T05:43:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 -- start start 2024-09-13T05:43:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143c07a3c0 0x7f143c1095b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f143c109af0 con 0x7f143c07a3c0 2024-09-13T05:43:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f1440eeb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143c07a3c0 0x7f143c1095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f1440eeb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143c07a3c0 0x7f143c1095b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51166/0 (socket says 172.21.15.79:51166) 2024-09-13T05:43:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f1440eeb640 1 -- 172.21.15.79:0/1616609397 learned_addr learned my addr 172.21.15.79:0/1616609397 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f1440eeb640 1 -- 172.21.15.79:0/1616609397 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143c109c70 con 0x7f143c07a3c0 2024-09-13T05:43:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f1440eeb640 1 --2- 172.21.15.79:0/1616609397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143c07a3c0 0x7f143c1095b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1430009820 tx=0x7f143002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8680ca10c8a32fc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f143b7fe640 1 -- 172.21.15.79:0/1616609397 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1430037070 con 0x7f143c07a3c0 2024-09-13T05:43:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f143b7fe640 1 -- 172.21.15.79:0/1616609397 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f14300328c0 con 0x7f143c07a3c0 2024-09-13T05:43:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f143b7fe640 1 -- 172.21.15.79:0/1616609397 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1430030640 con 0x7f143c07a3c0 2024-09-13T05:43:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 -- 172.21.15.79:0/1616609397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143c07a3c0 msgr2=0x7f143c1095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:18.604 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 --2- 172.21.15.79:0/1616609397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143c07a3c0 0x7f143c1095b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1430009820 tx=0x7f143002a270 comp rx=0 tx=0).stop 2024-09-13T05:43:18.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 -- 172.21.15.79:0/1616609397 shutdown_connections 2024-09-13T05:43:18.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 --2- 172.21.15.79:0/1616609397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143c07a3c0 0x7f143c1095b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:18.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 -- 172.21.15.79:0/1616609397 >> 172.21.15.79:0/1616609397 conn(0x7f143c101160 msgr2=0x7f143c103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:18.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 -- 172.21.15.79:0/1616609397 shutdown_connections 2024-09-13T05:43:18.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 -- 172.21.15.79:0/1616609397 wait complete. 2024-09-13T05:43:18.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 Processor -- start 2024-09-13T05:43:18.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 -- start start 2024-09-13T05:43:18.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143c07a3c0 0x7f143c190480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:18.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f144314f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f143c10ad10 con 0x7f143c07a3c0 2024-09-13T05:43:18.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f1440eeb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143c07a3c0 0x7f143c190480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:18.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f1440eeb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143c07a3c0 0x7f143c190480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51176/0 (socket says 172.21.15.79:51176) 2024-09-13T05:43:18.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.712+0000 7f1440eeb640 1 -- 172.21.15.79:0/3710100481 learned_addr learned my addr 172.21.15.79:0/3710100481 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:18.605 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.716+0000 7f1440eeb640 1 -- 172.21.15.79:0/3710100481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143c1909e0 con 0x7f143c07a3c0 2024-09-13T05:43:18.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.716+0000 7f1440eeb640 1 --2- 172.21.15.79:0/3710100481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143c07a3c0 0x7f143c190480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1430000c00 tx=0x7f1430030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:18.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.716+0000 7f1439ffb640 1 -- 172.21.15.79:0/3710100481 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1430037040 con 0x7f143c07a3c0 2024-09-13T05:43:18.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.716+0000 7f1439ffb640 1 -- 172.21.15.79:0/3710100481 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f1430040070 con 0x7f143c07a3c0 2024-09-13T05:43:18.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.716+0000 7f1439ffb640 1 -- 172.21.15.79:0/3710100481 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f143003a390 con 0x7f143c07a3c0 2024-09-13T05:43:18.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.716+0000 7f144314f640 1 -- 172.21.15.79:0/3710100481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143c190c70 con 0x7f143c07a3c0 2024-09-13T05:43:18.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.716+0000 7f144314f640 1 -- 172.21.15.79:0/3710100481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f143c191630 con 0x7f143c07a3c0 2024-09-13T05:43:18.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.716+0000 7f1439ffb640 1 -- 172.21.15.79:0/3710100481 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 10) ==== 51743+0+0 (secure 0 0 0) 0x7f143003a530 con 0x7f143c07a3c0 2024-09-13T05:43:18.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.716+0000 7f1439ffb640 1 --2- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/3535502969 conn(0x7f142c03f770 0x7f142c041c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:18.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.716+0000 7f144314f640 1 -- 172.21.15.79:0/3710100481 --> v2:172.21.15.79:6800/3535502969 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f143c1075a0 con 0x7f142c03f770 2024-09-13T05:43:18.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.716+0000 7f1439ffb640 1 -- 172.21.15.79:0/3710100481 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f1430074c40 con 0x7f143c07a3c0 2024-09-13T05:43:18.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.716+0000 7f143bfff640 1 -- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/3535502969 conn(0x7f142c03f770 msgr2=0x7f142c041c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/3535502969 2024-09-13T05:43:18.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.716+0000 7f143bfff640 1 --2- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/3535502969 conn(0x7f142c03f770 0x7f142c041c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T05:43:18.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.920+0000 7f143bfff640 1 -- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/3535502969 conn(0x7f142c03f770 msgr2=0x7f142c041c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/3535502969 2024-09-13T05:43:18.606 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:14.920+0000 7f143bfff640 1 --2- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/3535502969 conn(0x7f142c03f770 0x7f142c041c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T05:43:18.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:15.324+0000 7f143bfff640 1 -- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/3535502969 conn(0x7f142c03f770 msgr2=0x7f142c041c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/3535502969 2024-09-13T05:43:18.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:15.324+0000 7f143bfff640 1 --2- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/3535502969 conn(0x7f142c03f770 0x7f142c041c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T05:43:18.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:16.128+0000 7f143bfff640 1 -- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/3535502969 conn(0x7f142c03f770 msgr2=0x7f142c041c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/3535502969 2024-09-13T05:43:18.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:16.128+0000 7f143bfff640 1 --2- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/3535502969 conn(0x7f142c03f770 0x7f142c041c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T05:43:18.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:16.892+0000 7f1439ffb640 1 -- 172.21.15.79:0/3710100481 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mgrmap(e 11) ==== 51545+0+0 (secure 0 0 0) 0x7f1430073a40 con 0x7f143c07a3c0 2024-09-13T05:43:18.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:16.892+0000 7f1439ffb640 1 -- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/3535502969 conn(0x7f142c03f770 msgr2=0x7f142c041c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T05:43:18.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:16.892+0000 7f1439ffb640 1 --2- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/3535502969 conn(0x7f142c03f770 0x7f142c041c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:18.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.892+0000 7f1439ffb640 1 -- 172.21.15.79:0/3710100481 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 12) ==== 51637+0+0 (secure 0 0 0) 0x7f143003a820 con 0x7f143c07a3c0 2024-09-13T05:43:18.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.892+0000 7f1439ffb640 1 --2- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/614049769 conn(0x7f142c042f70 0x7f142c045360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:18.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.892+0000 7f1439ffb640 1 -- 172.21.15.79:0/3710100481 --> v2:172.21.15.79:6800/614049769 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f143003ba10 con 0x7f142c042f70 2024-09-13T05:43:18.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.892+0000 7f143bfff640 1 --2- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/614049769 conn(0x7f142c042f70 0x7f142c045360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:18.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.892+0000 7f143bfff640 1 --2- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/614049769 conn(0x7f142c042f70 0x7f142c045360 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1428003980 tx=0x7f14280092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:18.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.896+0000 7f1439ffb640 1 -- 172.21.15.79:0/3710100481 <== mgr.14152 v2:172.21.15.79:6800/614049769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f143003ba10 con 0x7f142c042f70 2024-09-13T05:43:18.607 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.912+0000 7f144314f640 1 -- 172.21.15.79:0/3710100481 --> v2:172.21.15.79:6800/614049769 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f143c102260 con 0x7f142c042f70 2024-09-13T05:43:18.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.912+0000 7f1439ffb640 1 -- 172.21.15.79:0/3710100481 <== mgr.14152 v2:172.21.15.79:6800/614049769 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f143c102260 con 0x7f142c042f70 2024-09-13T05:43:18.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.912+0000 7f144314f640 1 -- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/614049769 conn(0x7f142c042f70 msgr2=0x7f142c045360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:18.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.912+0000 7f144314f640 1 --2- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/614049769 conn(0x7f142c042f70 0x7f142c045360 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1428003980 tx=0x7f14280092b0 comp rx=0 tx=0).stop 2024-09-13T05:43:18.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.912+0000 7f144314f640 1 -- 172.21.15.79:0/3710100481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143c07a3c0 msgr2=0x7f143c190480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:18.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.912+0000 7f144314f640 1 --2- 172.21.15.79:0/3710100481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143c07a3c0 0x7f143c190480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1430000c00 tx=0x7f1430030b70 comp rx=0 tx=0).stop 2024-09-13T05:43:18.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.912+0000 7f144314f640 1 -- 172.21.15.79:0/3710100481 shutdown_connections 2024-09-13T05:43:18.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.912+0000 7f144314f640 1 --2- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/614049769 conn(0x7f142c042f70 0x7f142c045360 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:18.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.912+0000 7f144314f640 1 --2- 172.21.15.79:0/3710100481 >> v2:172.21.15.79:6800/3535502969 conn(0x7f142c03f770 0x7f142c041c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:18.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.912+0000 7f144314f640 1 --2- 172.21.15.79:0/3710100481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143c07a3c0 0x7f143c190480 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:18.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.912+0000 7f144314f640 1 -- 172.21.15.79:0/3710100481 >> 172.21.15.79:0/3710100481 conn(0x7f143c101160 msgr2=0x7f143c101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:18.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.912+0000 7f144314f640 1 -- 172.21.15.79:0/3710100481 shutdown_connections 2024-09-13T05:43:18.608 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:17.912+0000 7f144314f640 1 -- 172.21.15.79:0/3710100481 wait complete. 2024-09-13T05:43:18.608 INFO:teuthology.orchestra.run.smithi079.stdout:mgr epoch 10 is available 2024-09-13T05:43:18.609 INFO:teuthology.orchestra.run.smithi079.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-13T05:43:18.737 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: debug 2024-09-13T05:43:18.444+0000 7f7a6280e640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:05:43:18] ENGINE Error in HTTPServer.serve 2024-09-13T05:43:18.737 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: Traceback (most recent call last): 2024-09-13T05:43:18.738 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T05:43:18.738 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: self._connections.run(self.expiration_interval) 2024-09-13T05:43:18.738 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T05:43:18.738 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: self._run(expiration_interval) 2024-09-13T05:43:18.738 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T05:43:18.738 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T05:43:18.738 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T05:43:18.738 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T05:43:18.738 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T05:43:18.738 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: s = self.context.wrap_socket( 2024-09-13T05:43:18.738 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T05:43:18.738 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: return self.sslsocket_class._create( 2024-09-13T05:43:18.738 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T05:43:18.739 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: self.do_handshake() 2024-09-13T05:43:18.739 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T05:43:18.739 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: self._sslobj.do_handshake() 2024-09-13T05:43:18.739 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[23069]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T05:43:19.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: cephadm 2024-09-13T05:43:18.226877+0000 mgr.y (mgr.14152) 3 : cephadm [INF] [13/Sep/2024:05:43:18] ENGINE Bus STARTING 2024-09-13T05:43:19.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: cephadm 2024-09-13T05:43:18.226877+0000 mgr.y (mgr.14152) 3 : cephadm [INF] [13/Sep/2024:05:43:18] ENGINE Bus STARTING 2024-09-13T05:43:19.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: cephadm 2024-09-13T05:43:18.328563+0000 mgr.y (mgr.14152) 4 : cephadm [INF] [13/Sep/2024:05:43:18] ENGINE Serving on http://172.21.15.79:8765 2024-09-13T05:43:19.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: cephadm 2024-09-13T05:43:18.328563+0000 mgr.y (mgr.14152) 4 : cephadm [INF] [13/Sep/2024:05:43:18] ENGINE Serving on http://172.21.15.79:8765 2024-09-13T05:43:19.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: cephadm 2024-09-13T05:43:18.447827+0000 mgr.y (mgr.14152) 5 : cephadm [INF] [13/Sep/2024:05:43:18] ENGINE Serving on https://172.21.15.79:7150 2024-09-13T05:43:19.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: cephadm 2024-09-13T05:43:18.447827+0000 mgr.y (mgr.14152) 5 : cephadm [INF] [13/Sep/2024:05:43:18] ENGINE Serving on https://172.21.15.79:7150 2024-09-13T05:43:19.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: cephadm 2024-09-13T05:43:18.447996+0000 mgr.y (mgr.14152) 6 : cephadm [INF] [13/Sep/2024:05:43:18] ENGINE Bus STARTED 2024-09-13T05:43:19.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: cephadm 2024-09-13T05:43:18.447996+0000 mgr.y (mgr.14152) 6 : cephadm [INF] [13/Sep/2024:05:43:18] ENGINE Bus STARTED 2024-09-13T05:43:19.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: cephadm 2024-09-13T05:43:18.449613+0000 mgr.y (mgr.14152) 7 : cephadm [ERR] [13/Sep/2024:05:43:18] ENGINE Error in HTTPServer.serve 2024-09-13T05:43:19.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: Traceback (most recent call last): 2024-09-13T05:43:19.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T05:43:19.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: self._connections.run(self.expiration_interval) 2024-09-13T05:43:19.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T05:43:19.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: self._run(expiration_interval) 2024-09-13T05:43:19.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T05:43:19.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T05:43:19.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T05:43:19.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T05:43:19.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T05:43:19.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: s = self.context.wrap_socket( 2024-09-13T05:43:19.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T05:43:19.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: return self.sslsocket_class._create( 2024-09-13T05:43:19.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T05:43:19.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: self.do_handshake() 2024-09-13T05:43:19.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T05:43:19.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: self._sslobj.do_handshake() 2024-09-13T05:43:19.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T05:43:19.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: cephadm 2024-09-13T05:43:18.449613+0000 mgr.y (mgr.14152) 7 : cephadm [ERR] [13/Sep/2024:05:43:18] ENGINE Error in HTTPServer.serve 2024-09-13T05:43:19.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: Traceback (most recent call last): 2024-09-13T05:43:19.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T05:43:19.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: self._connections.run(self.expiration_interval) 2024-09-13T05:43:19.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T05:43:19.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: self._run(expiration_interval) 2024-09-13T05:43:19.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T05:43:19.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T05:43:19.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T05:43:19.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T05:43:19.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T05:43:19.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: s = self.context.wrap_socket( 2024-09-13T05:43:19.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T05:43:19.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: return self.sslsocket_class._create( 2024-09-13T05:43:19.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T05:43:19.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: self.do_handshake() 2024-09-13T05:43:19.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T05:43:19.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: self._sslobj.do_handshake() 2024-09-13T05:43:19.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:18 smithi079 bash[22814]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T05:43:20.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:19 smithi079 bash[22814]: cluster 2024-09-13T05:43:18.963453+0000 mon.a (mon.0) 92 : cluster [DBG] mgrmap e13: y(active, since 2s) 2024-09-13T05:43:20.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:19 smithi079 bash[22814]: cluster 2024-09-13T05:43:18.963453+0000 mon.a (mon.0) 92 : cluster [DBG] mgrmap e13: y(active, since 2s) 2024-09-13T05:43:21.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:20 smithi079 bash[22814]: audit 2024-09-13T05:43:20.235947+0000 mgr.y (mgr.14152) 8 : audit [DBG] from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:21.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:20 smithi079 bash[22814]: audit 2024-09-13T05:43:20.235947+0000 mgr.y (mgr.14152) 8 : audit [DBG] from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:21.496 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUaBPJFbK+i4QJ0AOgPNXfIliDaNAwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxMzA1NDMyMFoXDTM0\nMDkxNDA1NDMyMFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1Ljc5MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAvuuYdftS2yle8g7/p66yH/gL4aqOEM5t7b6m\nYyUUA/XVEk5TCXPhT/KO6qiPKIZRrSLABk4H5CsEP1BlPCOAUYdb/ndKG13LBPyi\nFQX+XTZ1ThWrQ9CfDNm7tmOFfjbaNUoArzaykrc9Wzyaiy4kPpmyIomwU8D5HPY3\n/uARLcXvcv1sOjohT5ebfRb/DEUIR9B2GQGlYytZ+J2UQH81K9xcCLgjVf/w/LU6\nCWWv2QswKpiYPGtzvhiAWm7iDsbiyBYOGo8anlRUC7vTxhNZ/Mx631z1v9KaK1MU\nes80ZFWZWRN+gBIJHqzaN6u14MTcVvQpSQ82K9OJgAaZF8pWksAPcx/E2TqOpN9m\n+dn5N0ApXd6U/mIZ3m9xXsKYOGY91anAVDWLd2urRSHoBjf8+rXuG04sdOL0jjBc\nYORdsJvTUjVr1HPOoltUeotRhd0cgjR6nW6fXm37DPwilFM1Y38HgejENGp7qCWr\ncC6mmUEXUzSs6qQFX/u02IGmK6muyVa5muGOfNSl0jBPK4Jy6deaRKp/YLG2PI26\nptYcjDnF7TcjYiN9yDnDToap4sSX6U0LS+Klkc4IW1vS2wKdUHoJ3VTido0AKZFq\ngYSlv10i+2NyyYTg8SpXuuEnZz/QfFgWmQKP5jThNEkP1n3WvsKZg1nkozCW5NK7\noMKFobMCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDc5ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPTzAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAt\niX2cFMZuZNYl5Q2tX0+s7ucnJk44r3vkU3XxNCSoPLi8mBhynnGw4XnGCtq0jxgI\nEn+zdCXvAGxOPCFldM3nKnkZQLzNShXedAaUQMmqRptxlYaqIaI2uJPPlkpLRYos\nq3WngnjtgOhySs66e+SWRsyvZZ5eF7rVx7wZuTjE5aw2YpXAjPIJ+Y8+BMXgNMDn\nM758C8LqRSNKOhj8a5VT9MXKmDnxto//oXeYcW81vfGxJJ4fEVF5TqjcsMOuu4vz\nBluBIx2HTtyA2Zcog2duo9z2/lBrDiwE9f5WbqSPZbjTSj4RsgmYyAu6slHgboMa\nN/YzcrUda9ms2p1Lg7evfMxB8t4QqIjJicyhLTBCGH6YFL1hCucoQ17xleCOuPMS\n5Lui33XVdO+oiIPPfbSAMsJJq/bbsQzhyeHjIVp4Nht1NC56+b2a5mWb6wQtjq2P\n2A/CWJRRF74UIDGKEg6v7HJeHET9o8Iru1VUCZ05cqXvZsJA7yQL3aV4QaMEwn9K\npMOuLnILtx6Ldx6DkpVPiz5HAYoS83R86nj9WocHs8g8VwvDsBdjSyJtKugSzGEl\n71fQYAlsgEG1g91jxI84iiwAyJLegL3/VKa0MyWZMvF/A3s19+WTJDMfewLp1R6a\nSLDI8Vn8YKsVCg02kYP4XtTfpt+2JRMfCrZJ08L3ow==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAvuuYdftS2yle8g7/p66yH/gL4aqOEM5t7b6mYyUUA/XVEk5T\nCXPhT/KO6qiPKIZRrSLABk4H5CsEP1BlPCOAUYdb/ndKG13LBPyiFQX+XTZ1ThWr\nQ9CfDNm7tmOFfjbaNUoArzaykrc9Wzyaiy4kPpmyIomwU8D5HPY3/uARLcXvcv1s\nOjohT5ebfRb/DEUIR9B2GQGlYytZ+J2UQH81K9xcCLgjVf/w/LU6CWWv2QswKpiY\nPGtzvhiAWm7iDsbiyBYOGo8anlRUC7vTxhNZ/Mx631z1v9KaK1MUes80ZFWZWRN+\ngBIJHqzaN6u14MTcVvQpSQ82K9OJgAaZF8pWksAPcx/E2TqOpN9m+dn5N0ApXd6U\n/mIZ3m9xXsKYOGY91anAVDWLd2urRSHoBjf8+rXuG04sdOL0jjBcYORdsJvTUjVr\n1HPOoltUeotRhd0cgjR6nW6fXm37DPwilFM1Y38HgejENGp7qCWrcC6mmUEXUzSs\n6qQFX/u02IGmK6muyVa5muGOfNSl0jBPK4Jy6deaRKp/YLG2PI26ptYcjDnF7Tcj\nYiN9yDnDToap4sSX6U0LS+Klkc4IW1vS2wKdUHoJ3VTido0AKZFqgYSlv10i+2Ny\nyYTg8SpXuuEnZz/QfFgWmQKP5jThNEkP1n3WvsKZg1nkozCW5NK7oMKFobMCAwEA\nAQKCAgBGKGdPO7rX5J0KUG6sHOtCCjG7jKRGEsWcrwmPt2lihyz0XCnxeE7cxSK1\noplw5+MNv45XAsetlg0qgw2git81los8uHNYGSBoxbl+BkTR1hhHSHk2I2y/GSf8\nvxeoKNoI6RfVS0FV3tZCN8QGzz7sbihivrw4GtqwRN6Q36AQdQMn+26Q+xmQmQK/\ndfrldFy1nyo2yD8RcTXPwYBgLx7H7mM3pQr/KF1TT/lyyJZVKOJbVNXkpgvTWEea\nc9LIYVem9UvbgKjkc9KquSv6RtQzrKSefheklOyobRBCjPAQys/eRuaeg4IsbpKG\nEKh2X4EkxvaA7YEXm9WUYVhSwL0M70NjjqdJPr81kTLJ+yWzEV7dMwWyOSQfvT9x\nEC3FM+efefmBnNnJsh2rvyhAnwgkk3/xbdDPVzFfpji7otpg7hS98eOtHy2Ogij5\nsYCHCy0B7eMxjXvGB0li5rmsYF5CFX7mn4TGsA8vboOMsrpeH0h22SsEiYYZ92+W\nq4m7aqM5U/kYbU4idOu/jQh1qb2NlJVih0bRyw+TELCEiBo+UUO4fChb+j7QI3cS\nUgZ9bAb5mOooNKpu00+a07WbpYZSELy2IgLtyc2A5dTjWnqt+dTahuYKtc2HZ2uG\ncTvycCo0j6yKt7y7DVPdwrR4qvmlovolmoVV5TFrRm1qCNDp8QKCAQEA8TXr42pb\nurpixIRSUgug9Wz89CXfOsoX1bLwQHDm9U8u9SbhnJ4ChVmmeNUoMymC+5okIw2n\nVeRh1fsNnLVSmYFwYRGenGNuhd/f4s189/YQ0sdbVZ3iqMsbw9sUDZ4MnzEQvzvY\nc8Xh9RB32tDc1LOm2qkON+hVFDNu99hR3Cqaow7tCJh1ga8Fr+QWX7MGpuaiAnyD\nfVwIk086nsAx0adqGUa49pkYvE1bYGxYNeWojhLd/upIH7UjWRk67Ek+djrUWZ3j\nUEZFlytDyu5th3XTdK+oa9RfjuqdNp041avlPrQRheW+oCrNUcyVB/Iy1Q4+0P5J\nbO+At2uOo7TayQKCAQEAyqBPNH/omGPX+MJ0W/oQde+/MY9T4+dZT4Cwm/RCNkHL\nVGuSx+sJr/8Bb3LxVJL4Nx4YCeY6mmrZF+LUuYOyRHZtb5suIC8Si0DsT+cL6BKm\nHiKfftY5lnxWX3HDtR+/hIxW9zeR2+yONJIMnfTfY4y2wyAAY15uvBOSg+Z1oh5G\nHg6THqJUzgupCueSlnbjdFyFqVjLpSnjhz0IDgCPOKgAhNicAlVZCLtFCoe+bQQ8\nF1xWpNPhVHSNfjVEw6j0W1kuxhX3E31YhS6inuAPK0qc6trhcpfGm77yRE7OX0so\nj2Avvqk19mmvbIITER4voedmzGk2AqH5tq7J+QbamwKCAQBF0sEM3K3e+LM8hb06\nqMkYIkt69TeQUg3iO2EWllgU7K4AIxgt+QNrzI7G7ZUscjjLUkxhpUMqNuknQvwm\nv8pAS1rXjn0mchX9RNgPVEJ3mNA346OJviFtkRXhdRpx8q1eq5pYcR9wK/kDspev\nTMSQAc0sAMHv5x4xsc3OitzvaZnH17s/wLpLJvnzd4gOfclQKPT+2UJK2IhW9BlY\n+POy585rsLA8GgcyAwaPe+1w9KD9N3LxpqnoG8w2r3oCChW9rbvokS7K/vyIDOsb\n5Dbqfm4Omgab6CcdPMbzl0FrgM3kf8WOx/mNbbZvllQRr8eNKwl+AA4LLa1J6yWo\nN+MZAoIBAEK63rrMcP5Wy1Z6O7XaubcNWKrqp9cDZq8/E2qY24Fg06SetL0wE4Wp\ndoCMmxueNy53s7T25E/cZlhudF4QGBJh6hJ6SYuB1RqVK/34ejxYf+qmvl4YEOkV\nU6ClJ62roff1++H4pAmIcyCvBIa0kSkIu1uxW09eVxuLWpIjwJO+Ypsdc6gAD+u3\nfVlBAE6bIrc8jSxDOPXQwMTV/aQW3RPsiBc3+tDt6J9uhQM9xyHB5kRPPZ2Uxb15\nkOuCgX3qU2cODNBhhXgerJtXy2iFI5m/PcQ+h0ak41yBWunSBjbt2pK1O6QPt9zJ\n22Lhx4O4rDkmqv0gnQ/q5gEauRtQ/YcCggEBAKJp5MnR1iSIqEx6kX4mAzpLRU3I\nyQyKhgGCW1KvK6wp5pArwAsgTc4dVaTe42BqLvr/E2HSPW0BuGLYaJYmcfnQFDCz\n10JGeqvzxbASkYKkOkTTrR/D19iMtkWUUw6k+kwi/ra3kkDLJb2aC6nlCL7QnJat\nea3yK86rk+i904Hvur2N7prRsAMvMAwXVXfDp3eSnPmaIzH2gn7bYEem+srupnYE\nQlYWdShxR7VXyul2Y5kRwJG4udq3B42YBi9F5Z4oPOYa91Is0lTAhQD0tHG9ANdH\nPkPH0GgmYNW5VCe/AzHoqQadBF/3bN5Hk0IOtHUGTZnLHBj+r/jnknMSsXo=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-13T05:43:21.496 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.864+0000 7f2d0823a640 1 Processor -- start 2024-09-13T05:43:21.496 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.864+0000 7f2d0823a640 1 -- start start 2024-09-13T05:43:21.496 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.864+0000 7f2d0823a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d00108b40 0x7f2d00108f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:21.496 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.864+0000 7f2d0823a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2d00109530 con 0x7f2d00108b40 2024-09-13T05:43:21.496 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.864+0000 7f2d05fd6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d00108b40 0x7f2d00108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:21.496 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.864+0000 7f2d05fd6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d00108b40 0x7f2d00108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51230/0 (socket says 172.21.15.79:51230) 2024-09-13T05:43:21.496 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.864+0000 7f2d05fd6640 1 -- 172.21.15.79:0/221281990 learned_addr learned my addr 172.21.15.79:0/221281990 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:21.496 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.864+0000 7f2d05fd6640 1 -- 172.21.15.79:0/221281990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d001096b0 con 0x7f2d00108b40 2024-09-13T05:43:21.496 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.864+0000 7f2d05fd6640 1 --2- 172.21.15.79:0/221281990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d00108b40 0x7f2d00108f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0009820 tx=0x7f2cf002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606cf447a080de52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:21.497 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.864+0000 7f2d04fd4640 1 -- 172.21.15.79:0/221281990 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cf0037070 con 0x7f2d00108b40 2024-09-13T05:43:21.497 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.864+0000 7f2d04fd4640 1 -- 172.21.15.79:0/221281990 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f2cf00328c0 con 0x7f2d00108b40 2024-09-13T05:43:21.497 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.864+0000 7f2d04fd4640 1 -- 172.21.15.79:0/221281990 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cf0030640 con 0x7f2d00108b40 2024-09-13T05:43:21.497 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d0823a640 1 -- 172.21.15.79:0/221281990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d00108b40 msgr2=0x7f2d00108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:21.497 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d0823a640 1 --2- 172.21.15.79:0/221281990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d00108b40 0x7f2d00108f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0009820 tx=0x7f2cf002a270 comp rx=0 tx=0).stop 2024-09-13T05:43:21.497 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d0823a640 1 -- 172.21.15.79:0/221281990 shutdown_connections 2024-09-13T05:43:21.497 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d0823a640 1 --2- 172.21.15.79:0/221281990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d00108b40 0x7f2d00108f40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:21.497 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d0823a640 1 -- 172.21.15.79:0/221281990 >> 172.21.15.79:0/221281990 conn(0x7f2d0007c350 msgr2=0x7f2d0007c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:21.497 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d0823a640 1 -- 172.21.15.79:0/221281990 shutdown_connections 2024-09-13T05:43:21.497 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d0823a640 1 -- 172.21.15.79:0/221281990 wait complete. 2024-09-13T05:43:21.497 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d0823a640 1 Processor -- start 2024-09-13T05:43:21.497 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d0823a640 1 -- start start 2024-09-13T05:43:21.497 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d0823a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d00108b40 0x7f2d0019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:21.498 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d0823a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0010cfc0 con 0x7f2d00108b40 2024-09-13T05:43:21.498 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d05fd6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d00108b40 0x7f2d0019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:21.498 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d05fd6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d00108b40 0x7f2d0019ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51240/0 (socket says 172.21.15.79:51240) 2024-09-13T05:43:21.498 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d05fd6640 1 -- 172.21.15.79:0/1276255556 learned_addr learned my addr 172.21.15.79:0/1276255556 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:21.498 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d05fd6640 1 -- 172.21.15.79:0/1276255556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0019cfa0 con 0x7f2d00108b40 2024-09-13T05:43:21.498 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d05fd6640 1 --2- 172.21.15.79:0/1276255556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d00108b40 0x7f2d0019ca40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2cf002a830 tx=0x7f2cf0030bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:21.498 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2cfeffd640 1 -- 172.21.15.79:0/1276255556 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cf0037040 con 0x7f2d00108b40 2024-09-13T05:43:21.498 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2cfeffd640 1 -- 172.21.15.79:0/1276255556 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f2cf0040070 con 0x7f2d00108b40 2024-09-13T05:43:21.498 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2cfeffd640 1 -- 172.21.15.79:0/1276255556 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cf003be40 con 0x7f2d00108b40 2024-09-13T05:43:21.498 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d0823a640 1 -- 172.21.15.79:0/1276255556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0019d230 con 0x7f2d00108b40 2024-09-13T05:43:21.498 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d0823a640 1 -- 172.21.15.79:0/1276255556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d0019dbf0 con 0x7f2d00108b40 2024-09-13T05:43:21.498 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2d0823a640 1 -- 172.21.15.79:0/1276255556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d00108f40 con 0x7f2d00108b40 2024-09-13T05:43:21.499 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2cfeffd640 1 -- 172.21.15.79:0/1276255556 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) ==== 51743+0+0 (secure 0 0 0) 0x7f2cf003b430 con 0x7f2d00108b40 2024-09-13T05:43:21.499 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2cfeffd640 1 --2- 172.21.15.79:0/1276255556 >> v2:172.21.15.79:6800/614049769 conn(0x7f2ce803f770 0x7f2ce8041c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:21.499 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.868+0000 7f2cfeffd640 1 -- 172.21.15.79:0/1276255556 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f2cf0073f90 con 0x7f2d00108b40 2024-09-13T05:43:21.499 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.872+0000 7f2d057d5640 1 --2- 172.21.15.79:0/1276255556 >> v2:172.21.15.79:6800/614049769 conn(0x7f2ce803f770 0x7f2ce8041c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:21.499 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.872+0000 7f2d057d5640 1 --2- 172.21.15.79:0/1276255556 >> v2:172.21.15.79:6800/614049769 conn(0x7f2ce803f770 0x7f2ce8041c30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40098c0 tx=0x7f2cf4006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:21.499 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:19.876+0000 7f2cfeffd640 1 -- 172.21.15.79:0/1276255556 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f2cf00313a0 con 0x7f2d00108b40 2024-09-13T05:43:21.499 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:20.228+0000 7f2d0823a640 1 -- 172.21.15.79:0/1276255556 --> v2:172.21.15.79:6800/614049769 -- mgr_command(tid 0: {"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}) -- 0x7f2d0019e460 con 0x7f2ce803f770 2024-09-13T05:43:21.499 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:20.916+0000 7f2cfeffd640 1 -- 172.21.15.79:0/1276255556 <== mgr.14152 v2:172.21.15.79:6800/614049769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5136 (secure 0 0 0) 0x7f2d0019e460 con 0x7f2ce803f770 2024-09-13T05:43:21.499 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:20.920+0000 7f2d0823a640 1 -- 172.21.15.79:0/1276255556 >> v2:172.21.15.79:6800/614049769 conn(0x7f2ce803f770 msgr2=0x7f2ce8041c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:21.499 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:20.920+0000 7f2d0823a640 1 --2- 172.21.15.79:0/1276255556 >> v2:172.21.15.79:6800/614049769 conn(0x7f2ce803f770 0x7f2ce8041c30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40098c0 tx=0x7f2cf4006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:21.499 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:20.920+0000 7f2d0823a640 1 -- 172.21.15.79:0/1276255556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d00108b40 msgr2=0x7f2d0019ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:21.499 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:20.920+0000 7f2d0823a640 1 --2- 172.21.15.79:0/1276255556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d00108b40 0x7f2d0019ca40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2cf002a830 tx=0x7f2cf0030bc0 comp rx=0 tx=0).stop 2024-09-13T05:43:21.499 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:20.920+0000 7f2d0823a640 1 -- 172.21.15.79:0/1276255556 shutdown_connections 2024-09-13T05:43:21.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:20.920+0000 7f2d0823a640 1 --2- 172.21.15.79:0/1276255556 >> v2:172.21.15.79:6800/614049769 conn(0x7f2ce803f770 0x7f2ce8041c30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:21.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:20.920+0000 7f2d0823a640 1 --2- 172.21.15.79:0/1276255556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d00108b40 0x7f2d0019ca40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:21.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:20.920+0000 7f2d0823a640 1 -- 172.21.15.79:0/1276255556 >> 172.21.15.79:0/1276255556 conn(0x7f2d0007c350 msgr2=0x7f2d00106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:21.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:20.920+0000 7f2d0823a640 1 -- 172.21.15.79:0/1276255556 shutdown_connections 2024-09-13T05:43:21.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:20.920+0000 7f2d0823a640 1 -- 172.21.15.79:0/1276255556 wait complete. 2024-09-13T05:43:23.539 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-13T05:43:23.540 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f1754fec640 1 Processor -- start 2024-09-13T05:43:23.540 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f1754fec640 1 -- start start 2024-09-13T05:43:23.540 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f1754fec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1750106960 0x7f1750106d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:23.540 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f1754fec640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1750107350 con 0x7f1750106960 2024-09-13T05:43:23.540 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f174e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1750106960 0x7f1750106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:23.540 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f174e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1750106960 0x7f1750106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51244/0 (socket says 172.21.15.79:51244) 2024-09-13T05:43:23.540 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f174e59c640 1 -- 172.21.15.79:0/3130379923 learned_addr learned my addr 172.21.15.79:0/3130379923 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:23.540 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f174e59c640 1 -- 172.21.15.79:0/3130379923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17501074d0 con 0x7f1750106960 2024-09-13T05:43:23.540 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f174e59c640 1 --2- 172.21.15.79:0/3130379923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1750106960 0x7f1750106d60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1740009820 tx=0x7f174002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ca90ee14bb6ca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:23.540 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f174d59a640 1 -- 172.21.15.79:0/3130379923 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1740037070 con 0x7f1750106960 2024-09-13T05:43:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f174d59a640 1 -- 172.21.15.79:0/3130379923 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f17400328c0 con 0x7f1750106960 2024-09-13T05:43:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f174d59a640 1 -- 172.21.15.79:0/3130379923 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1740030640 con 0x7f1750106960 2024-09-13T05:43:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f1754fec640 1 -- 172.21.15.79:0/3130379923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1750106960 msgr2=0x7f1750106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f1754fec640 1 --2- 172.21.15.79:0/3130379923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1750106960 0x7f1750106d60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1740009820 tx=0x7f174002a270 comp rx=0 tx=0).stop 2024-09-13T05:43:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f1754fec640 1 -- 172.21.15.79:0/3130379923 shutdown_connections 2024-09-13T05:43:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f1754fec640 1 --2- 172.21.15.79:0/3130379923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1750106960 0x7f1750106d60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f1754fec640 1 -- 172.21.15.79:0/3130379923 >> 172.21.15.79:0/3130379923 conn(0x7f1750102250 msgr2=0x7f1750104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f1754fec640 1 -- 172.21.15.79:0/3130379923 shutdown_connections 2024-09-13T05:43:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.564+0000 7f1754fec640 1 -- 172.21.15.79:0/3130379923 wait complete. 2024-09-13T05:43:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f1754fec640 1 Processor -- start 2024-09-13T05:43:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f1754fec640 1 -- start start 2024-09-13T05:43:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f1754fec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1750106960 0x7f175007c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f1754fec640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f175010ade0 con 0x7f1750106960 2024-09-13T05:43:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f174e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1750106960 0x7f175007c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f174e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1750106960 0x7f175007c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51254/0 (socket says 172.21.15.79:51254) 2024-09-13T05:43:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f174e59c640 1 -- 172.21.15.79:0/95482149 learned_addr learned my addr 172.21.15.79:0/95482149 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f174e59c640 1 -- 172.21.15.79:0/95482149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175007cef0 con 0x7f1750106960 2024-09-13T05:43:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f174e59c640 1 --2- 172.21.15.79:0/95482149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1750106960 0x7f175007c990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1740000c00 tx=0x7f1740030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f17477fe640 1 -- 172.21.15.79:0/95482149 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1740037040 con 0x7f1750106960 2024-09-13T05:43:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f17477fe640 1 -- 172.21.15.79:0/95482149 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f1740040070 con 0x7f1750106960 2024-09-13T05:43:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f17477fe640 1 -- 172.21.15.79:0/95482149 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174003a390 con 0x7f1750106960 2024-09-13T05:43:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f1754fec640 1 -- 172.21.15.79:0/95482149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175007b2e0 con 0x7f1750106960 2024-09-13T05:43:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f1754fec640 1 -- 172.21.15.79:0/95482149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f175007b860 con 0x7f1750106960 2024-09-13T05:43:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f17477fe640 1 -- 172.21.15.79:0/95482149 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) ==== 51743+0+0 (secure 0 0 0) 0x7f174003b430 con 0x7f1750106960 2024-09-13T05:43:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f1754fec640 1 -- 172.21.15.79:0/95482149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1750106d60 con 0x7f1750106960 2024-09-13T05:43:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f17477fe640 1 --2- 172.21.15.79:0/95482149 >> v2:172.21.15.79:6800/614049769 conn(0x7f173c03f770 0x7f173c041c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f17477fe640 1 -- 172.21.15.79:0/95482149 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f1740074350 con 0x7f1750106960 2024-09-13T05:43:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f174dd9b640 1 --2- 172.21.15.79:0/95482149 >> v2:172.21.15.79:6800/614049769 conn(0x7f173c03f770 0x7f173c041c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.568+0000 7f174dd9b640 1 --2- 172.21.15.79:0/95482149 >> v2:172.21.15.79:6800/614049769 conn(0x7f173c03f770 0x7f173c041c30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17380098c0 tx=0x7f1738006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.572+0000 7f17477fe640 1 -- 172.21.15.79:0/95482149 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f174003aae0 con 0x7f1750106960 2024-09-13T05:43:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.948+0000 7f1754fec640 1 -- 172.21.15.79:0/95482149 --> v2:172.21.15.79:6800/614049769 -- mgr_command(tid 0: {"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}) -- 0x7f175007bd90 con 0x7f173c03f770 2024-09-13T05:43:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.956+0000 7f17477fe640 1 -- 172.21.15.79:0/95482149 <== mgr.14152 v2:172.21.15.79:6800/614049769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f175007bd90 con 0x7f173c03f770 2024-09-13T05:43:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.956+0000 7f1754fec640 1 -- 172.21.15.79:0/95482149 >> v2:172.21.15.79:6800/614049769 conn(0x7f173c03f770 msgr2=0x7f173c041c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.956+0000 7f1754fec640 1 --2- 172.21.15.79:0/95482149 >> v2:172.21.15.79:6800/614049769 conn(0x7f173c03f770 0x7f173c041c30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17380098c0 tx=0x7f1738006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.956+0000 7f1754fec640 1 -- 172.21.15.79:0/95482149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1750106960 msgr2=0x7f175007c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.956+0000 7f1754fec640 1 --2- 172.21.15.79:0/95482149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1750106960 0x7f175007c990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1740000c00 tx=0x7f1740030b70 comp rx=0 tx=0).stop 2024-09-13T05:43:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.956+0000 7f1754fec640 1 -- 172.21.15.79:0/95482149 shutdown_connections 2024-09-13T05:43:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.956+0000 7f1754fec640 1 --2- 172.21.15.79:0/95482149 >> v2:172.21.15.79:6800/614049769 conn(0x7f173c03f770 0x7f173c041c30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.956+0000 7f1754fec640 1 --2- 172.21.15.79:0/95482149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1750106960 0x7f175007c990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:23.544 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.956+0000 7f1754fec640 1 -- 172.21.15.79:0/95482149 >> 172.21.15.79:0/95482149 conn(0x7f1750102250 msgr2=0x7f1750102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:23.544 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.956+0000 7f1754fec640 1 -- 172.21.15.79:0/95482149 shutdown_connections 2024-09-13T05:43:23.544 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:22.956+0000 7f1754fec640 1 -- 172.21.15.79:0/95482149 wait complete. 2024-09-13T05:43:24.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:23 smithi079 bash[22814]: audit 2024-09-13T05:43:22.955801+0000 mgr.y (mgr.14152) 9 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:24.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:23 smithi079 bash[22814]: audit 2024-09-13T05:43:22.955801+0000 mgr.y (mgr.14152) 9 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:24.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:23 smithi079 bash[22814]: audit 2024-09-13T05:43:22.958855+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:24.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:23 smithi079 bash[22814]: audit 2024-09-13T05:43:22.958855+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:25.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:25 smithi079 bash[22814]: audit 2024-09-13T05:43:24.204598+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:25.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:25 smithi079 bash[22814]: audit 2024-09-13T05:43:24.204598+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:25.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:25 smithi079 bash[22814]: audit 2024-09-13T05:43:24.978003+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:25.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:25 smithi079 bash[22814]: audit 2024-09-13T05:43:24.978003+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:25.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-13T05:43:25.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.568+0000 7f0bde725640 1 Processor -- start 2024-09-13T05:43:25.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.568+0000 7f0bde725640 1 -- start start 2024-09-13T05:43:25.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.568+0000 7f0bde725640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bd807a330 0x7f0bd810b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:25.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.568+0000 7f0bde725640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd807a730 con 0x7f0bd807a330 2024-09-13T05:43:25.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.568+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bd807a330 0x7f0bd810b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:25.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bd807a330 0x7f0bd810b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43958/0 (socket says 172.21.15.79:43958) 2024-09-13T05:43:25.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bd7fff640 1 -- 172.21.15.79:0/3123241847 learned_addr learned my addr 172.21.15.79:0/3123241847 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:25.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bd7fff640 1 -- 172.21.15.79:0/3123241847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd810be60 con 0x7f0bd807a330 2024-09-13T05:43:25.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bd7fff640 1 --2- 172.21.15.79:0/3123241847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bd807a330 0x7f0bd810b920 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009820 tx=0x7f0bc802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9211bb41cbf54874 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:25.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bd6ffd640 1 -- 172.21.15.79:0/3123241847 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc8037070 con 0x7f0bd807a330 2024-09-13T05:43:25.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bd6ffd640 1 -- 172.21.15.79:0/3123241847 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f0bc80328c0 con 0x7f0bd807a330 2024-09-13T05:43:25.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bd6ffd640 1 -- 172.21.15.79:0/3123241847 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc8030640 con 0x7f0bd807a330 2024-09-13T05:43:25.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bde725640 1 -- 172.21.15.79:0/3123241847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bd807a330 msgr2=0x7f0bd810b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:25.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bde725640 1 --2- 172.21.15.79:0/3123241847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bd807a330 0x7f0bd810b920 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009820 tx=0x7f0bc802a270 comp rx=0 tx=0).stop 2024-09-13T05:43:25.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bde725640 1 -- 172.21.15.79:0/3123241847 shutdown_connections 2024-09-13T05:43:25.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bde725640 1 --2- 172.21.15.79:0/3123241847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bd807a330 0x7f0bd810b920 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:25.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bde725640 1 -- 172.21.15.79:0/3123241847 >> 172.21.15.79:0/3123241847 conn(0x7f0bd81011b0 msgr2=0x7f0bd81035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:25.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bde725640 1 -- 172.21.15.79:0/3123241847 shutdown_connections 2024-09-13T05:43:25.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bde725640 1 -- 172.21.15.79:0/3123241847 wait complete. 2024-09-13T05:43:25.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bde725640 1 Processor -- start 2024-09-13T05:43:25.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bde725640 1 -- start start 2024-09-13T05:43:25.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bde725640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bd807a330 0x7f0bd819ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:25.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bde725640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd810cf10 con 0x7f0bd807a330 2024-09-13T05:43:25.558 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bd807a330 0x7f0bd819ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:25.558 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bd807a330 0x7f0bd819ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43966/0 (socket says 172.21.15.79:43966) 2024-09-13T05:43:25.558 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bd7fff640 1 -- 172.21.15.79:0/1580185654 learned_addr learned my addr 172.21.15.79:0/1580185654 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:25.558 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.572+0000 7f0bd7fff640 1 -- 172.21.15.79:0/1580185654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd819cf80 con 0x7f0bd807a330 2024-09-13T05:43:25.558 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.576+0000 7f0bd7fff640 1 --2- 172.21.15.79:0/1580185654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bd807a330 0x7f0bd819ca20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000c00 tx=0x7f0bc8030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:25.558 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.576+0000 7f0bd57fa640 1 -- 172.21.15.79:0/1580185654 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc8037040 con 0x7f0bd807a330 2024-09-13T05:43:25.558 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.576+0000 7f0bd57fa640 1 -- 172.21.15.79:0/1580185654 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f0bc8040070 con 0x7f0bd807a330 2024-09-13T05:43:25.558 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.576+0000 7f0bde725640 1 -- 172.21.15.79:0/1580185654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd819d210 con 0x7f0bd807a330 2024-09-13T05:43:25.558 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.576+0000 7f0bd57fa640 1 -- 172.21.15.79:0/1580185654 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc803a390 con 0x7f0bd807a330 2024-09-13T05:43:25.558 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.576+0000 7f0bde725640 1 -- 172.21.15.79:0/1580185654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd819dbd0 con 0x7f0bd807a330 2024-09-13T05:43:25.558 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.576+0000 7f0bd57fa640 1 -- 172.21.15.79:0/1580185654 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) ==== 51743+0+0 (secure 0 0 0) 0x7f0bc803a610 con 0x7f0bd807a330 2024-09-13T05:43:25.558 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.576+0000 7f0bde725640 1 -- 172.21.15.79:0/1580185654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bd810b920 con 0x7f0bd807a330 2024-09-13T05:43:25.558 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.576+0000 7f0bd57fa640 1 --2- 172.21.15.79:0/1580185654 >> v2:172.21.15.79:6800/614049769 conn(0x7f0bc403f720 0x7f0bc4041be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:25.558 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.576+0000 7f0bd57fa640 1 -- 172.21.15.79:0/1580185654 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f0bc8074510 con 0x7f0bd807a330 2024-09-13T05:43:25.559 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.576+0000 7f0bd77fe640 1 --2- 172.21.15.79:0/1580185654 >> v2:172.21.15.79:6800/614049769 conn(0x7f0bc403f720 0x7f0bc4041be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:25.559 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.576+0000 7f0bd77fe640 1 --2- 172.21.15.79:0/1580185654 >> v2:172.21.15.79:6800/614049769 conn(0x7f0bc403f720 0x7f0bc4041be0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0bc00098c0 tx=0x7f0bc0006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:25.559 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.580+0000 7f0bd57fa640 1 -- 172.21.15.79:0/1580185654 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f0bc80313a0 con 0x7f0bd807a330 2024-09-13T05:43:25.559 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.968+0000 7f0bde725640 1 -- 172.21.15.79:0/1580185654 --> v2:172.21.15.79:6800/614049769 -- mgr_command(tid 0: {"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}) -- 0x7f0bd81022b0 con 0x7f0bc403f720 2024-09-13T05:43:25.559 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.972+0000 7f0bd57fa640 1 -- 172.21.15.79:0/1580185654 <== mgr.14152 v2:172.21.15.79:6800/614049769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f0bd81022b0 con 0x7f0bc403f720 2024-09-13T05:43:25.559 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.976+0000 7f0bde725640 1 -- 172.21.15.79:0/1580185654 >> v2:172.21.15.79:6800/614049769 conn(0x7f0bc403f720 msgr2=0x7f0bc4041be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:25.559 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.976+0000 7f0bde725640 1 --2- 172.21.15.79:0/1580185654 >> v2:172.21.15.79:6800/614049769 conn(0x7f0bc403f720 0x7f0bc4041be0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0bc00098c0 tx=0x7f0bc0006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:25.559 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.976+0000 7f0bde725640 1 -- 172.21.15.79:0/1580185654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bd807a330 msgr2=0x7f0bd819ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:25.559 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.976+0000 7f0bde725640 1 --2- 172.21.15.79:0/1580185654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bd807a330 0x7f0bd819ca20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000c00 tx=0x7f0bc8030b70 comp rx=0 tx=0).stop 2024-09-13T05:43:25.559 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.976+0000 7f0bde725640 1 -- 172.21.15.79:0/1580185654 shutdown_connections 2024-09-13T05:43:25.559 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.976+0000 7f0bde725640 1 --2- 172.21.15.79:0/1580185654 >> v2:172.21.15.79:6800/614049769 conn(0x7f0bc403f720 0x7f0bc4041be0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:25.559 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.976+0000 7f0bde725640 1 --2- 172.21.15.79:0/1580185654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bd807a330 0x7f0bd819ca20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:25.560 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.976+0000 7f0bde725640 1 -- 172.21.15.79:0/1580185654 >> 172.21.15.79:0/1580185654 conn(0x7f0bd81011b0 msgr2=0x7f0bd8101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:25.560 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.976+0000 7f0bde725640 1 -- 172.21.15.79:0/1580185654 shutdown_connections 2024-09-13T05:43:25.560 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:24.976+0000 7f0bde725640 1 -- 172.21.15.79:0/1580185654 wait complete. 2024-09-13T05:43:25.560 INFO:teuthology.orchestra.run.smithi079.stdout:Creating initial admin user... 2024-09-13T05:43:26.582 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:26 smithi079 bash[22814]: audit 2024-09-13T05:43:24.974609+0000 mgr.y (mgr.14152) 10 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:26.582 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:26 smithi079 bash[22814]: audit 2024-09-13T05:43:24.974609+0000 mgr.y (mgr.14152) 10 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:26.582 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:26 smithi079 bash[22814]: audit 2024-09-13T05:43:25.330290+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:26.582 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:26 smithi079 bash[22814]: audit 2024-09-13T05:43:25.330290+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:27.979 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$4TDTReRFhcfrGETuMzhRg.3lNBl.jYuQETxevd21/TTH0h7jScocW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726206207, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T05:43:27.980 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe547550640 1 Processor -- start 2024-09-13T05:43:27.980 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe547550640 1 -- start start 2024-09-13T05:43:27.980 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe547550640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540108b40 0x7fe540108f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:27.980 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe547550640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe540109530 con 0x7fe540108b40 2024-09-13T05:43:27.980 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe5452ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540108b40 0x7fe540108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:27.980 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe5452ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540108b40 0x7fe540108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43970/0 (socket says 172.21.15.79:43970) 2024-09-13T05:43:27.980 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe5452ec640 1 -- 172.21.15.79:0/4187756510 learned_addr learned my addr 172.21.15.79:0/4187756510 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:27.980 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe5452ec640 1 -- 172.21.15.79:0/4187756510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5401096b0 con 0x7fe540108b40 2024-09-13T05:43:27.980 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe5452ec640 1 --2- 172.21.15.79:0/4187756510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540108b40 0x7fe540108f40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009e80 tx=0x7fe53c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d843952b18e18dc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:27.980 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe537fff640 1 -- 172.21.15.79:0/4187756510 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe53c036070 con 0x7fe540108b40 2024-09-13T05:43:27.980 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe537fff640 1 -- 172.21.15.79:0/4187756510 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fe53c031880 con 0x7fe540108b40 2024-09-13T05:43:27.981 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe537fff640 1 -- 172.21.15.79:0/4187756510 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe53c007880 con 0x7fe540108b40 2024-09-13T05:43:27.981 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe547550640 1 -- 172.21.15.79:0/4187756510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540108b40 msgr2=0x7fe540108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:27.981 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe547550640 1 --2- 172.21.15.79:0/4187756510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540108b40 0x7fe540108f40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009e80 tx=0x7fe53c02a7a0 comp rx=0 tx=0).stop 2024-09-13T05:43:27.981 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe547550640 1 -- 172.21.15.79:0/4187756510 shutdown_connections 2024-09-13T05:43:27.981 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe547550640 1 --2- 172.21.15.79:0/4187756510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540108b40 0x7fe540108f40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:27.981 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe547550640 1 -- 172.21.15.79:0/4187756510 >> 172.21.15.79:0/4187756510 conn(0x7fe54007c350 msgr2=0x7fe54007c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:27.981 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe547550640 1 -- 172.21.15.79:0/4187756510 shutdown_connections 2024-09-13T05:43:27.981 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.700+0000 7fe547550640 1 -- 172.21.15.79:0/4187756510 wait complete. 2024-09-13T05:43:27.981 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe547550640 1 Processor -- start 2024-09-13T05:43:27.981 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe547550640 1 -- start start 2024-09-13T05:43:27.981 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe547550640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540108b40 0x7fe54019cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:27.981 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe547550640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe54010cfc0 con 0x7fe540108b40 2024-09-13T05:43:27.981 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe5452ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540108b40 0x7fe54019cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:27.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe5452ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540108b40 0x7fe54019cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43986/0 (socket says 172.21.15.79:43986) 2024-09-13T05:43:27.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe5452ec640 1 -- 172.21.15.79:0/1457750683 learned_addr learned my addr 172.21.15.79:0/1457750683 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:27.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe5452ec640 1 -- 172.21.15.79:0/1457750683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54019d030 con 0x7fe540108b40 2024-09-13T05:43:27.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe5452ec640 1 --2- 172.21.15.79:0/1457750683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540108b40 0x7fe54019cad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe53c008dc0 tx=0x7fe53c008df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:27.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe5367fc640 1 -- 172.21.15.79:0/1457750683 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe53c041020 con 0x7fe540108b40 2024-09-13T05:43:27.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe5367fc640 1 -- 172.21.15.79:0/1457750683 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fe53c03c8f0 con 0x7fe540108b40 2024-09-13T05:43:27.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe5367fc640 1 -- 172.21.15.79:0/1457750683 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe53c036040 con 0x7fe540108b40 2024-09-13T05:43:27.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe547550640 1 -- 172.21.15.79:0/1457750683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54019d2c0 con 0x7fe540108b40 2024-09-13T05:43:27.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe547550640 1 -- 172.21.15.79:0/1457750683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe54019dd00 con 0x7fe540108b40 2024-09-13T05:43:27.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe5367fc640 1 -- 172.21.15.79:0/1457750683 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) ==== 51743+0+0 (secure 0 0 0) 0x7fe53c044020 con 0x7fe540108b40 2024-09-13T05:43:27.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe547550640 1 -- 172.21.15.79:0/1457750683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe540108fc0 con 0x7fe540108b40 2024-09-13T05:43:27.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe5367fc640 1 --2- 172.21.15.79:0/1457750683 >> v2:172.21.15.79:6800/614049769 conn(0x7fe52c03f770 0x7fe52c041c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:27.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe5367fc640 1 -- 172.21.15.79:0/1457750683 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fe53c075570 con 0x7fe540108b40 2024-09-13T05:43:27.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe544aeb640 1 --2- 172.21.15.79:0/1457750683 >> v2:172.21.15.79:6800/614049769 conn(0x7fe52c03f770 0x7fe52c041c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:27.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.704+0000 7fe544aeb640 1 --2- 172.21.15.79:0/1457750683 >> v2:172.21.15.79:6800/614049769 conn(0x7fe52c03f770 0x7fe52c041c30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe5300098c0 tx=0x7fe530006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:27.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:26.708+0000 7fe5367fc640 1 -- 172.21.15.79:0/1457750683 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7fe53c04b020 con 0x7fe540108b40 2024-09-13T05:43:27.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:27.072+0000 7fe547550640 1 -- 172.21.15.79:0/1457750683 --> v2:172.21.15.79:6800/614049769 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fe540106dd0 con 0x7fe52c03f770 2024-09-13T05:43:27.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:27.364+0000 7fe5367fc640 1 -- 172.21.15.79:0/1457750683 <== mgr.14152 v2:172.21.15.79:6800/614049769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fe540106dd0 con 0x7fe52c03f770 2024-09-13T05:43:27.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:27.368+0000 7fe547550640 1 -- 172.21.15.79:0/1457750683 >> v2:172.21.15.79:6800/614049769 conn(0x7fe52c03f770 msgr2=0x7fe52c041c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:27.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:27.368+0000 7fe547550640 1 --2- 172.21.15.79:0/1457750683 >> v2:172.21.15.79:6800/614049769 conn(0x7fe52c03f770 0x7fe52c041c30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe5300098c0 tx=0x7fe530006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:27.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:27.368+0000 7fe547550640 1 -- 172.21.15.79:0/1457750683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540108b40 msgr2=0x7fe54019cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:27.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:27.368+0000 7fe547550640 1 --2- 172.21.15.79:0/1457750683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540108b40 0x7fe54019cad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe53c008dc0 tx=0x7fe53c008df0 comp rx=0 tx=0).stop 2024-09-13T05:43:27.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:27.368+0000 7fe547550640 1 -- 172.21.15.79:0/1457750683 shutdown_connections 2024-09-13T05:43:27.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:27.368+0000 7fe547550640 1 --2- 172.21.15.79:0/1457750683 >> v2:172.21.15.79:6800/614049769 conn(0x7fe52c03f770 0x7fe52c041c30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:27.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:27.368+0000 7fe547550640 1 --2- 172.21.15.79:0/1457750683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540108b40 0x7fe54019cad0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:27.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:27.368+0000 7fe547550640 1 -- 172.21.15.79:0/1457750683 >> 172.21.15.79:0/1457750683 conn(0x7fe54007c350 msgr2=0x7fe5401066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:27.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:27.368+0000 7fe547550640 1 -- 172.21.15.79:0/1457750683 shutdown_connections 2024-09-13T05:43:27.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:27.368+0000 7fe547550640 1 -- 172.21.15.79:0/1457750683 wait complete. 2024-09-13T05:43:27.984 INFO:teuthology.orchestra.run.smithi079.stdout:Fetching dashboard port number... 2024-09-13T05:43:28.737 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:28 smithi079 bash[22814]: audit 2024-09-13T05:43:27.078187+0000 mgr.y (mgr.14152) 11 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:28.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:28 smithi079 bash[22814]: audit 2024-09-13T05:43:27.078187+0000 mgr.y (mgr.14152) 11 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:28.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:28 smithi079 bash[22814]: audit 2024-09-13T05:43:27.367414+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:28.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:28 smithi079 bash[22814]: audit 2024-09-13T05:43:27.367414+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:29.920 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T05:43:29.920 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.028+0000 7f0bce390640 1 Processor -- start 2024-09-13T05:43:29.920 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.028+0000 7f0bce390640 1 -- start start 2024-09-13T05:43:29.920 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.028+0000 7f0bce390640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc8106930 0x7f0bc8106d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:29.920 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.028+0000 7f0bce390640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc8107320 con 0x7f0bc8106930 2024-09-13T05:43:29.920 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bc7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc8106930 0x7f0bc8106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:29.920 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bc7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc8106930 0x7f0bc8106d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43990/0 (socket says 172.21.15.79:43990) 2024-09-13T05:43:29.920 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bc7fff640 1 -- 172.21.15.79:0/4240621473 learned_addr learned my addr 172.21.15.79:0/4240621473 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:29.920 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bc7fff640 1 -- 172.21.15.79:0/4240621473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc81074a0 con 0x7f0bc8106930 2024-09-13T05:43:29.921 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bc7fff640 1 --2- 172.21.15.79:0/4240621473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc8106930 0x7f0bc8106d30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0009e80 tx=0x7f0bc002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265135faa2197483 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:29.921 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bc6ffd640 1 -- 172.21.15.79:0/4240621473 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc0036070 con 0x7f0bc8106930 2024-09-13T05:43:29.921 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bc6ffd640 1 -- 172.21.15.79:0/4240621473 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f0bc0031880 con 0x7f0bc8106930 2024-09-13T05:43:29.921 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bc6ffd640 1 -- 172.21.15.79:0/4240621473 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc0007880 con 0x7f0bc8106930 2024-09-13T05:43:29.921 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bce390640 1 -- 172.21.15.79:0/4240621473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc8106930 msgr2=0x7f0bc8106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:29.921 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bce390640 1 --2- 172.21.15.79:0/4240621473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc8106930 0x7f0bc8106d30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0009e80 tx=0x7f0bc002a7a0 comp rx=0 tx=0).stop 2024-09-13T05:43:29.921 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bce390640 1 -- 172.21.15.79:0/4240621473 shutdown_connections 2024-09-13T05:43:29.921 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bce390640 1 --2- 172.21.15.79:0/4240621473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc8106930 0x7f0bc8106d30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:29.921 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bce390640 1 -- 172.21.15.79:0/4240621473 >> 172.21.15.79:0/4240621473 conn(0x7f0bc8102240 msgr2=0x7f0bc8104660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:29.921 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bce390640 1 -- 172.21.15.79:0/4240621473 shutdown_connections 2024-09-13T05:43:29.921 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bce390640 1 -- 172.21.15.79:0/4240621473 wait complete. 2024-09-13T05:43:29.921 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bce390640 1 Processor -- start 2024-09-13T05:43:29.922 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bce390640 1 -- start start 2024-09-13T05:43:29.922 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bce390640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc8106930 0x7f0bc819a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:29.922 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bce390640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc810adb0 con 0x7f0bc8106930 2024-09-13T05:43:29.922 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bc7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc8106930 0x7f0bc819a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:29.922 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bc7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc8106930 0x7f0bc819a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43994/0 (socket says 172.21.15.79:43994) 2024-09-13T05:43:29.922 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bc7fff640 1 -- 172.21.15.79:0/2986978193 learned_addr learned my addr 172.21.15.79:0/2986978193 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:29.922 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bc7fff640 1 -- 172.21.15.79:0/2986978193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc819ae00 con 0x7f0bc8106930 2024-09-13T05:43:29.922 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.032+0000 7f0bc7fff640 1 --2- 172.21.15.79:0/2986978193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc8106930 0x7f0bc819a8a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0008dc0 tx=0x7f0bc0008df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:29.922 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.036+0000 7f0bc57fa640 1 -- 172.21.15.79:0/2986978193 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc0041020 con 0x7f0bc8106930 2024-09-13T05:43:29.922 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.036+0000 7f0bc57fa640 1 -- 172.21.15.79:0/2986978193 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f0bc003c8f0 con 0x7f0bc8106930 2024-09-13T05:43:29.922 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.036+0000 7f0bce390640 1 -- 172.21.15.79:0/2986978193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc819b090 con 0x7f0bc8106930 2024-09-13T05:43:29.922 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.036+0000 7f0bc57fa640 1 -- 172.21.15.79:0/2986978193 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bc0036040 con 0x7f0bc8106930 2024-09-13T05:43:29.922 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.036+0000 7f0bce390640 1 -- 172.21.15.79:0/2986978193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc819bad0 con 0x7f0bc8106930 2024-09-13T05:43:29.923 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.036+0000 7f0bce390640 1 -- 172.21.15.79:0/2986978193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ba80050b0 con 0x7f0bc8106930 2024-09-13T05:43:29.923 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.036+0000 7f0bc57fa640 1 -- 172.21.15.79:0/2986978193 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) ==== 51743+0+0 (secure 0 0 0) 0x7f0bc0044020 con 0x7f0bc8106930 2024-09-13T05:43:29.923 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.036+0000 7f0bc57fa640 1 --2- 172.21.15.79:0/2986978193 >> v2:172.21.15.79:6800/614049769 conn(0x7f0bb403f770 0x7f0bb4041c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:29.923 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.036+0000 7f0bc57fa640 1 -- 172.21.15.79:0/2986978193 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f0bc00756c0 con 0x7f0bc8106930 2024-09-13T05:43:29.923 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.036+0000 7f0bc77fe640 1 --2- 172.21.15.79:0/2986978193 >> v2:172.21.15.79:6800/614049769 conn(0x7f0bb403f770 0x7f0bb4041c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:29.923 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.036+0000 7f0bc77fe640 1 --2- 172.21.15.79:0/2986978193 >> v2:172.21.15.79:6800/614049769 conn(0x7f0bb403f770 0x7f0bb4041c30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00098c0 tx=0x7f0bb0006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:29.923 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.040+0000 7f0bc57fa640 1 -- 172.21.15.79:0/2986978193 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f0bc004b020 con 0x7f0bc8106930 2024-09-13T05:43:29.923 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.368+0000 7f0bc57fa640 1 -- 172.21.15.79:0/2986978193 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 14) ==== 51786+0+0 (secure 0 0 0) 0x7f0bc0046400 con 0x7f0bc8106930 2024-09-13T05:43:29.923 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.376+0000 7f0bce390640 1 -- 172.21.15.79:0/2986978193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f0ba80053a0 con 0x7f0bc8106930 2024-09-13T05:43:29.923 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.376+0000 7f0bc57fa640 1 -- 172.21.15.79:0/2986978193 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f0bc0037260 con 0x7f0bc8106930 2024-09-13T05:43:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.380+0000 7f0bce390640 1 -- 172.21.15.79:0/2986978193 >> v2:172.21.15.79:6800/614049769 conn(0x7f0bb403f770 msgr2=0x7f0bb4041c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.380+0000 7f0bce390640 1 --2- 172.21.15.79:0/2986978193 >> v2:172.21.15.79:6800/614049769 conn(0x7f0bb403f770 0x7f0bb4041c30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00098c0 tx=0x7f0bb0006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.380+0000 7f0bce390640 1 -- 172.21.15.79:0/2986978193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc8106930 msgr2=0x7f0bc819a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.380+0000 7f0bce390640 1 --2- 172.21.15.79:0/2986978193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc8106930 0x7f0bc819a8a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0008dc0 tx=0x7f0bc0008df0 comp rx=0 tx=0).stop 2024-09-13T05:43:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.380+0000 7f0bce390640 1 -- 172.21.15.79:0/2986978193 shutdown_connections 2024-09-13T05:43:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.380+0000 7f0bce390640 1 --2- 172.21.15.79:0/2986978193 >> v2:172.21.15.79:6800/614049769 conn(0x7f0bb403f770 0x7f0bb4041c30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.380+0000 7f0bce390640 1 --2- 172.21.15.79:0/2986978193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc8106930 0x7f0bc819a8a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.380+0000 7f0bce390640 1 -- 172.21.15.79:0/2986978193 >> 172.21.15.79:0/2986978193 conn(0x7f0bc8102240 msgr2=0x7f0bc8102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.380+0000 7f0bce390640 1 -- 172.21.15.79:0/2986978193 shutdown_connections 2024-09-13T05:43:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:29.380+0000 7f0bce390640 1 -- 172.21.15.79:0/2986978193 wait complete. 2024-09-13T05:43:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld does not appear to be present 2024-09-13T05:43:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T05:43:29.925 INFO:teuthology.orchestra.run.smithi079.stdout:Ceph Dashboard is now available at: 2024-09-13T05:43:29.925 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-13T05:43:29.925 INFO:teuthology.orchestra.run.smithi079.stdout: URL: https://smithi079.front.sepia.ceph.com:8443/ 2024-09-13T05:43:29.925 INFO:teuthology.orchestra.run.smithi079.stdout: User: admin 2024-09-13T05:43:29.925 INFO:teuthology.orchestra.run.smithi079.stdout: Password: qfrdh2h8nd 2024-09-13T05:43:29.925 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-13T05:43:29.925 INFO:teuthology.orchestra.run.smithi079.stdout:Saving cluster configuration to /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config directory 2024-09-13T05:43:30.653 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:30 smithi079 bash[22814]: cluster 2024-09-13T05:43:29.374479+0000 mon.a (mon.0) 98 : cluster [DBG] mgrmap e14: y(active, since 12s) 2024-09-13T05:43:30.653 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:30 smithi079 bash[22814]: cluster 2024-09-13T05:43:29.374479+0000 mon.a (mon.0) 98 : cluster [DBG] mgrmap e14: y(active, since 12s) 2024-09-13T05:43:30.653 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:30 smithi079 bash[22814]: audit 2024-09-13T05:43:29.381954+0000 mon.a (mon.0) 99 : audit [DBG] from='client.? 172.21.15.79:0/2986978193' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-13T05:43:30.653 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:30 smithi079 bash[22814]: audit 2024-09-13T05:43:29.381954+0000 mon.a (mon.0) 99 : audit [DBG] from='client.? 172.21.15.79:0/2986978193' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-13T05:43:32.860 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.471+0000 7f719f633640 1 Processor -- start 2024-09-13T05:43:32.860 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.471+0000 7f719f633640 1 -- start start 2024-09-13T05:43:32.860 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.471+0000 7f719f633640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7198108b40 0x7f7198108f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:32.860 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.471+0000 7f719f633640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7198109530 con 0x7f7198108b40 2024-09-13T05:43:32.861 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.471+0000 7f719d3cf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7198108b40 0x7f7198108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:32.861 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.471+0000 7f719d3cf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7198108b40 0x7f7198108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44006/0 (socket says 172.21.15.79:44006) 2024-09-13T05:43:32.861 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.471+0000 7f719d3cf640 1 -- 172.21.15.79:0/3319299238 learned_addr learned my addr 172.21.15.79:0/3319299238 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:32.861 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.471+0000 7f719d3cf640 1 -- 172.21.15.79:0/3319299238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71981096b0 con 0x7f7198108b40 2024-09-13T05:43:32.861 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719d3cf640 1 --2- 172.21.15.79:0/3319299238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7198108b40 0x7f7198108f40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7188009820 tx=0x7f718802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37457dac8966555b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:32.861 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f7197fff640 1 -- 172.21.15.79:0/3319299238 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7188037070 con 0x7f7198108b40 2024-09-13T05:43:32.861 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f7197fff640 1 -- 172.21.15.79:0/3319299238 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f71880328c0 con 0x7f7198108b40 2024-09-13T05:43:32.861 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f7197fff640 1 -- 172.21.15.79:0/3319299238 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7188030640 con 0x7f7198108b40 2024-09-13T05:43:32.861 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719f633640 1 -- 172.21.15.79:0/3319299238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7198108b40 msgr2=0x7f7198108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:32.861 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719f633640 1 --2- 172.21.15.79:0/3319299238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7198108b40 0x7f7198108f40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7188009820 tx=0x7f718802a270 comp rx=0 tx=0).stop 2024-09-13T05:43:32.861 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719f633640 1 -- 172.21.15.79:0/3319299238 shutdown_connections 2024-09-13T05:43:32.861 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719f633640 1 --2- 172.21.15.79:0/3319299238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7198108b40 0x7f7198108f40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:32.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719f633640 1 -- 172.21.15.79:0/3319299238 >> 172.21.15.79:0/3319299238 conn(0x7f719807c200 msgr2=0x7f719807c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:32.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719f633640 1 -- 172.21.15.79:0/3319299238 shutdown_connections 2024-09-13T05:43:32.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719f633640 1 -- 172.21.15.79:0/3319299238 wait complete. 2024-09-13T05:43:32.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719f633640 1 Processor -- start 2024-09-13T05:43:32.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719f633640 1 -- start start 2024-09-13T05:43:32.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719f633640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7198108b40 0x7f719819caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:32.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719f633640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f719810cfc0 con 0x7f7198108b40 2024-09-13T05:43:32.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719d3cf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7198108b40 0x7f719819caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:32.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719d3cf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7198108b40 0x7f719819caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44014/0 (socket says 172.21.15.79:44014) 2024-09-13T05:43:32.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719d3cf640 1 -- 172.21.15.79:0/1816569338 learned_addr learned my addr 172.21.15.79:0/1816569338 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:32.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719d3cf640 1 -- 172.21.15.79:0/1816569338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719819d000 con 0x7f7198108b40 2024-09-13T05:43:32.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719d3cf640 1 --2- 172.21.15.79:0/1816569338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7198108b40 0x7f719819caa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7188000c00 tx=0x7f7188030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:32.862 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f71967fc640 1 -- 172.21.15.79:0/1816569338 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7188037040 con 0x7f7198108b40 2024-09-13T05:43:32.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f71967fc640 1 -- 172.21.15.79:0/1816569338 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f7188040070 con 0x7f7198108b40 2024-09-13T05:43:32.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719f633640 1 -- 172.21.15.79:0/1816569338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719819d290 con 0x7f7198108b40 2024-09-13T05:43:32.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f71967fc640 1 -- 172.21.15.79:0/1816569338 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f718803a390 con 0x7f7198108b40 2024-09-13T05:43:32.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.475+0000 7f719f633640 1 -- 172.21.15.79:0/1816569338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f719819dc50 con 0x7f7198108b40 2024-09-13T05:43:32.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.479+0000 7f71967fc640 1 -- 172.21.15.79:0/1816569338 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) ==== 51786+0+0 (secure 0 0 0) 0x7f718803a530 con 0x7f7198108b40 2024-09-13T05:43:32.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.479+0000 7f719f633640 1 -- 172.21.15.79:0/1816569338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7198108f40 con 0x7f7198108b40 2024-09-13T05:43:32.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.479+0000 7f71967fc640 1 --2- 172.21.15.79:0/1816569338 >> v2:172.21.15.79:6800/614049769 conn(0x7f718003f7c0 0x7f7180041c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:32.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.479+0000 7f71967fc640 1 -- 172.21.15.79:0/1816569338 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f71880742c0 con 0x7f7198108b40 2024-09-13T05:43:32.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.479+0000 7f719cbce640 1 --2- 172.21.15.79:0/1816569338 >> v2:172.21.15.79:6800/614049769 conn(0x7f718003f7c0 0x7f7180041c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:32.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.479+0000 7f719cbce640 1 --2- 172.21.15.79:0/1816569338 >> v2:172.21.15.79:6800/614049769 conn(0x7f718003f7c0 0x7f7180041c80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f718c0098c0 tx=0x7f718c006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:32.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:31.483+0000 7f71967fc640 1 -- 172.21.15.79:0/1816569338 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f7188039980 con 0x7f7198108b40 2024-09-13T05:43:32.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:32.035+0000 7f719f633640 1 -- 172.21.15.79:0/1816569338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f719819e390 con 0x7f7198108b40 2024-09-13T05:43:32.863 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:32.043+0000 7f71967fc640 1 -- 172.21.15.79:0/1816569338 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f7188045460 con 0x7f7198108b40 2024-09-13T05:43:32.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T05:43:32.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:32.043+0000 7f719f633640 1 -- 172.21.15.79:0/1816569338 >> v2:172.21.15.79:6800/614049769 conn(0x7f718003f7c0 msgr2=0x7f7180041c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:32.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:32.043+0000 7f719f633640 1 --2- 172.21.15.79:0/1816569338 >> v2:172.21.15.79:6800/614049769 conn(0x7f718003f7c0 0x7f7180041c80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f718c0098c0 tx=0x7f718c006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:32.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:32.043+0000 7f719f633640 1 -- 172.21.15.79:0/1816569338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7198108b40 msgr2=0x7f719819caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:32.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:32.043+0000 7f719f633640 1 --2- 172.21.15.79:0/1816569338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7198108b40 0x7f719819caa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7188000c00 tx=0x7f7188030b70 comp rx=0 tx=0).stop 2024-09-13T05:43:32.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:32.043+0000 7f719f633640 1 -- 172.21.15.79:0/1816569338 shutdown_connections 2024-09-13T05:43:32.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:32.043+0000 7f719f633640 1 --2- 172.21.15.79:0/1816569338 >> v2:172.21.15.79:6800/614049769 conn(0x7f718003f7c0 0x7f7180041c80 secure :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f718c0098c0 tx=0x7f718c006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:32.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:32.043+0000 7f719f633640 1 --2- 172.21.15.79:0/1816569338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7198108b40 0x7f719819caa0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:32.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:32.043+0000 7f719f633640 1 -- 172.21.15.79:0/1816569338 >> 172.21.15.79:0/1816569338 conn(0x7f719807c200 msgr2=0x7f71981066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:32.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:32.043+0000 7f719f633640 1 -- 172.21.15.79:0/1816569338 shutdown_connections 2024-09-13T05:43:32.864 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-13T05:43:32.043+0000 7f719f633640 1 -- 172.21.15.79:0/1816569338 wait complete. 2024-09-13T05:43:32.864 INFO:teuthology.orchestra.run.smithi079.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T05:43:32.864 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-13T05:43:32.864 INFO:teuthology.orchestra.run.smithi079.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid bf551932-7192-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T05:43:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-13T05:43:32.865 INFO:teuthology.orchestra.run.smithi079.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T05:43:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-13T05:43:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T05:43:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-13T05:43:32.865 INFO:teuthology.orchestra.run.smithi079.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T05:43:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-13T05:43:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: ceph telemetry on 2024-09-13T05:43:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-13T05:43:32.865 INFO:teuthology.orchestra.run.smithi079.stdout:For more information see: 2024-09-13T05:43:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-13T05:43:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-13T05:43:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-13T05:43:32.866 INFO:teuthology.orchestra.run.smithi079.stdout:Bootstrap complete. 2024-09-13T05:43:32.912 INFO:tasks.cephadm:Fetching config... 2024-09-13T05:43:32.912 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:43:32.913 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T05:43:32.918 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T05:43:32.918 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:43:32.918 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T05:43:32.970 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T05:43:32.970 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:43:32.970 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-13T05:43:33.028 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T05:43:33.028 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:43:33.028 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T05:43:33.074 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T05:43:33.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8fvXQ3DIiV3gosR5/+cPPjTeDD8bjes0hjuqqiVKhv2+Tt0MBDS0BShymlMKdDl8f4pi/no+tcXNO2KlPRBYzjdEPcvu0v6TY5J+ghK1pYpqsOnUbkAhCchTwfNJWKSDdjjX0j8S2CdUXVYL6o9HIVfP0UmCHaLhFaw5nrwixZL6BIzQJsyao6VFfZy+03IQohxe/curNywrxnMA0zld+Yeokrs6GsWjcDwVtBHJpaDfJlUuhlRWu9CNTVju3T/3uQh2YZbHt3yAQR2xrLBYt1fDXIVV1xPZpZUQsY2eIM0Un8etcSo58L27aURgZL9KBZv4jFTiNPgjTtGI49o3Ghe5gHDiBWaBm1M7ZSZzrYFZtEf8tL48UJ6rF8OeXDkV7oNfki35NsT0C8W16Ij4bKko0X67fFc0JIupbBQPSDqa5u7jchx2hLQuSobHek7/OoOzhjfj+6oUNhkXKKsEXw45Gpnd9mgPKyBUwHMv/zMBnzilD7oZi7KzoAVqCH5k= ceph-bf551932-7192-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T05:43:33.138 INFO:teuthology.orchestra.run.smithi079.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8fvXQ3DIiV3gosR5/+cPPjTeDD8bjes0hjuqqiVKhv2+Tt0MBDS0BShymlMKdDl8f4pi/no+tcXNO2KlPRBYzjdEPcvu0v6TY5J+ghK1pYpqsOnUbkAhCchTwfNJWKSDdjjX0j8S2CdUXVYL6o9HIVfP0UmCHaLhFaw5nrwixZL6BIzQJsyao6VFfZy+03IQohxe/curNywrxnMA0zld+Yeokrs6GsWjcDwVtBHJpaDfJlUuhlRWu9CNTVju3T/3uQh2YZbHt3yAQR2xrLBYt1fDXIVV1xPZpZUQsY2eIM0Un8etcSo58L27aURgZL9KBZv4jFTiNPgjTtGI49o3Ghe5gHDiBWaBm1M7ZSZzrYFZtEf8tL48UJ6rF8OeXDkV7oNfki35NsT0C8W16Ij4bKko0X67fFc0JIupbBQPSDqa5u7jchx2hLQuSobHek7/OoOzhjfj+6oUNhkXKKsEXw45Gpnd9mgPKyBUwHMv/zMBnzilD7oZi7KzoAVqCH5k= ceph-bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:43:33.147 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8fvXQ3DIiV3gosR5/+cPPjTeDD8bjes0hjuqqiVKhv2+Tt0MBDS0BShymlMKdDl8f4pi/no+tcXNO2KlPRBYzjdEPcvu0v6TY5J+ghK1pYpqsOnUbkAhCchTwfNJWKSDdjjX0j8S2CdUXVYL6o9HIVfP0UmCHaLhFaw5nrwixZL6BIzQJsyao6VFfZy+03IQohxe/curNywrxnMA0zld+Yeokrs6GsWjcDwVtBHJpaDfJlUuhlRWu9CNTVju3T/3uQh2YZbHt3yAQR2xrLBYt1fDXIVV1xPZpZUQsY2eIM0Un8etcSo58L27aURgZL9KBZv4jFTiNPgjTtGI49o3Ghe5gHDiBWaBm1M7ZSZzrYFZtEf8tL48UJ6rF8OeXDkV7oNfki35NsT0C8W16Ij4bKko0X67fFc0JIupbBQPSDqa5u7jchx2hLQuSobHek7/OoOzhjfj+6oUNhkXKKsEXw45Gpnd9mgPKyBUwHMv/zMBnzilD7oZi7KzoAVqCH5k= ceph-bf551932-7192-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T05:43:33.169 INFO:teuthology.orchestra.run.smithi139.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8fvXQ3DIiV3gosR5/+cPPjTeDD8bjes0hjuqqiVKhv2+Tt0MBDS0BShymlMKdDl8f4pi/no+tcXNO2KlPRBYzjdEPcvu0v6TY5J+ghK1pYpqsOnUbkAhCchTwfNJWKSDdjjX0j8S2CdUXVYL6o9HIVfP0UmCHaLhFaw5nrwixZL6BIzQJsyao6VFfZy+03IQohxe/curNywrxnMA0zld+Yeokrs6GsWjcDwVtBHJpaDfJlUuhlRWu9CNTVju3T/3uQh2YZbHt3yAQR2xrLBYt1fDXIVV1xPZpZUQsY2eIM0Un8etcSo58L27aURgZL9KBZv4jFTiNPgjTtGI49o3Ghe5gHDiBWaBm1M7ZSZzrYFZtEf8tL48UJ6rF8OeXDkV7oNfki35NsT0C8W16Ij4bKko0X67fFc0JIupbBQPSDqa5u7jchx2hLQuSobHek7/OoOzhjfj+6oUNhkXKKsEXw45Gpnd9mgPKyBUwHMv/zMBnzilD7oZi7KzoAVqCH5k= ceph-bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:43:33.179 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T05:43:33.198 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:33 smithi079 bash[22814]: audit 2024-09-13T05:43:32.047365+0000 mon.a (mon.0) 100 : audit [INF] from='client.? 172.21.15.79:0/1816569338' entity='client.admin' 2024-09-13T05:43:33.198 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:33 smithi079 bash[22814]: audit 2024-09-13T05:43:32.047365+0000 mon.a (mon.0) 100 : audit [INF] from='client.? 172.21.15.79:0/1816569338' entity='client.admin' 2024-09-13T05:43:37.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:36 smithi079 bash[22814]: cluster 2024-09-13T05:43:36.905110+0000 mgr.y (mgr.14152) 12 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:37.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:36 smithi079 bash[22814]: cluster 2024-09-13T05:43:36.905110+0000 mgr.y (mgr.14152) 12 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:38.608 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T05:43:39.488 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:39 smithi079 bash[22814]: audit 2024-09-13T05:43:38.229931+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:39.488 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:39 smithi079 bash[22814]: audit 2024-09-13T05:43:38.229931+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:39.488 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:39 smithi079 bash[22814]: audit 2024-09-13T05:43:38.235712+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:39.488 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:39 smithi079 bash[22814]: audit 2024-09-13T05:43:38.235712+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:39.488 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:39 smithi079 bash[22814]: audit 2024-09-13T05:43:38.237878+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"} : dispatch 2024-09-13T05:43:39.489 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:39 smithi079 bash[22814]: audit 2024-09-13T05:43:38.237878+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"} : dispatch 2024-09-13T05:43:39.489 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:39 smithi079 bash[22814]: audit 2024-09-13T05:43:38.245163+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:39.489 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:39 smithi079 bash[22814]: audit 2024-09-13T05:43:38.245163+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:39.489 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:39 smithi079 bash[22814]: audit 2024-09-13T05:43:38.263356+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:43:39.489 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:39 smithi079 bash[22814]: audit 2024-09-13T05:43:38.263356+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:43:39.489 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:39 smithi079 bash[22814]: audit 2024-09-13T05:43:38.271504+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:39.489 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:39 smithi079 bash[22814]: audit 2024-09-13T05:43:38.271504+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:39.489 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:39 smithi079 bash[22814]: cluster 2024-09-13T05:43:38.905583+0000 mgr.y (mgr.14152) 13 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:39.489 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:39 smithi079 bash[22814]: cluster 2024-09-13T05:43:38.905583+0000 mgr.y (mgr.14152) 13 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:39.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17d2240640 1 -- 172.21.15.79:0/131158987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc06ba60 msgr2=0x7f17cc104ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:39.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17d2240640 1 --2- 172.21.15.79:0/131158987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc06ba60 0x7f17cc104ff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009880 tx=0x7f17bc02a5d0 comp rx=0 tx=0).stop 2024-09-13T05:43:39.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17d2240640 1 -- 172.21.15.79:0/131158987 shutdown_connections 2024-09-13T05:43:39.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17d2240640 1 --2- 172.21.15.79:0/131158987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc06ba60 0x7f17cc104ff0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:39.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17d2240640 1 -- 172.21.15.79:0/131158987 >> 172.21.15.79:0/131158987 conn(0x7f17cc0fcbe0 msgr2=0x7f17cc0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:39.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17d2240640 1 -- 172.21.15.79:0/131158987 shutdown_connections 2024-09-13T05:43:39.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17d2240640 1 -- 172.21.15.79:0/131158987 wait complete. 2024-09-13T05:43:39.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17d2240640 1 Processor -- start 2024-09-13T05:43:39.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17d2240640 1 -- start start 2024-09-13T05:43:39.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17d2240640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc06ba60 0x7f17cc102640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:39.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17d2240640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc107b10 con 0x7f17cc06ba60 2024-09-13T05:43:39.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17cb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc06ba60 0x7f17cc102640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:39.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17cb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc06ba60 0x7f17cc102640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58726/0 (socket says 172.21.15.79:58726) 2024-09-13T05:43:39.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17cb7fe640 1 -- 172.21.15.79:0/1831551373 learned_addr learned my addr 172.21.15.79:0/1831551373 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:39.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17cb7fe640 1 -- 172.21.15.79:0/1831551373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17cc102ba0 con 0x7f17cc06ba60 2024-09-13T05:43:39.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17cb7fe640 1 --2- 172.21.15.79:0/1831551373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc06ba60 0x7f17cc102640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f17bc005ab0 tx=0x7f17bc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:39.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17c8ff9640 1 -- 172.21.15.79:0/1831551373 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17bc03f070 con 0x7f17cc06ba60 2024-09-13T05:43:39.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17c8ff9640 1 -- 172.21.15.79:0/1831551373 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f17bc003ba0 con 0x7f17cc06ba60 2024-09-13T05:43:39.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17d2240640 1 -- 172.21.15.79:0/1831551373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17cc100f90 con 0x7f17cc06ba60 2024-09-13T05:43:39.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17c8ff9640 1 -- 172.21.15.79:0/1831551373 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17bc035030 con 0x7f17cc06ba60 2024-09-13T05:43:39.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.695+0000 7f17d2240640 1 -- 172.21.15.79:0/1831551373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17cc101510 con 0x7f17cc06ba60 2024-09-13T05:43:39.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.699+0000 7f17d2240640 1 -- 172.21.15.79:0/1831551373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17cc108290 con 0x7f17cc06ba60 2024-09-13T05:43:39.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.699+0000 7f17c8ff9640 1 -- 172.21.15.79:0/1831551373 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) ==== 51786+0+0 (secure 0 0 0) 0x7f17bc042070 con 0x7f17cc06ba60 2024-09-13T05:43:39.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.699+0000 7f17c8ff9640 1 --2- 172.21.15.79:0/1831551373 >> v2:172.21.15.79:6800/614049769 conn(0x7f17b403f7b0 0x7f17b4041c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:39.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.699+0000 7f17c8ff9640 1 -- 172.21.15.79:0/1831551373 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f17bc074db0 con 0x7f17cc06ba60 2024-09-13T05:43:39.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.699+0000 7f17caffd640 1 --2- 172.21.15.79:0/1831551373 >> v2:172.21.15.79:6800/614049769 conn(0x7f17b403f7b0 0x7f17b4041c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:39.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.699+0000 7f17caffd640 1 --2- 172.21.15.79:0/1831551373 >> v2:172.21.15.79:6800/614049769 conn(0x7f17b403f7b0 0x7f17b4041c70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f17c00098c0 tx=0x7f17c0006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.703+0000 7f17c8ff9640 1 -- 172.21.15.79:0/1831551373 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f17bc03b460 con 0x7f17cc06ba60 2024-09-13T05:43:39.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.895+0000 7f17d2240640 1 -- 172.21.15.79:0/1831551373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f17cc1018d0 con 0x7f17cc06ba60 2024-09-13T05:43:39.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.903+0000 7f17c8ff9640 1 -- 172.21.15.79:0/1831551373 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f17bc03f210 con 0x7f17cc06ba60 2024-09-13T05:43:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.903+0000 7f17d2240640 1 -- 172.21.15.79:0/1831551373 >> v2:172.21.15.79:6800/614049769 conn(0x7f17b403f7b0 msgr2=0x7f17b4041c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.903+0000 7f17d2240640 1 --2- 172.21.15.79:0/1831551373 >> v2:172.21.15.79:6800/614049769 conn(0x7f17b403f7b0 0x7f17b4041c70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f17c00098c0 tx=0x7f17c0006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.903+0000 7f17d2240640 1 -- 172.21.15.79:0/1831551373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc06ba60 msgr2=0x7f17cc102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.903+0000 7f17d2240640 1 --2- 172.21.15.79:0/1831551373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc06ba60 0x7f17cc102640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f17bc005ab0 tx=0x7f17bc0048f0 comp rx=0 tx=0).stop 2024-09-13T05:43:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.903+0000 7f17d2240640 1 -- 172.21.15.79:0/1831551373 shutdown_connections 2024-09-13T05:43:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.903+0000 7f17d2240640 1 --2- 172.21.15.79:0/1831551373 >> v2:172.21.15.79:6800/614049769 conn(0x7f17b403f7b0 0x7f17b4041c70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:39.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.903+0000 7f17d2240640 1 --2- 172.21.15.79:0/1831551373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17cc06ba60 0x7f17cc102640 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.903+0000 7f17d2240640 1 -- 172.21.15.79:0/1831551373 >> 172.21.15.79:0/1831551373 conn(0x7f17cc0fcbe0 msgr2=0x7f17cc0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.903+0000 7f17d2240640 1 -- 172.21.15.79:0/1831551373 shutdown_connections 2024-09-13T05:43:39.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:39.903+0000 7f17d2240640 1 -- 172.21.15.79:0/1831551373 wait complete. 2024-09-13T05:43:40.590 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T05:43:40.590 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T05:43:41.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:40 smithi079 bash[22814]: audit 2024-09-13T05:43:39.907033+0000 mon.a (mon.0) 107 : audit [INF] from='client.? 172.21.15.79:0/1831551373' entity='client.admin' 2024-09-13T05:43:41.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:40 smithi079 bash[22814]: audit 2024-09-13T05:43:39.907033+0000 mon.a (mon.0) 107 : audit [INF] from='client.? 172.21.15.79:0/1831551373' entity='client.admin' 2024-09-13T05:43:41.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:40 smithi079 bash[22814]: audit 2024-09-13T05:43:39.922964+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:43:41.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:40 smithi079 bash[22814]: audit 2024-09-13T05:43:39.922964+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:43:41.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:40 smithi079 bash[22814]: audit 2024-09-13T05:43:39.927971+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:41.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:40 smithi079 bash[22814]: audit 2024-09-13T05:43:39.927971+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:42.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:41 smithi079 bash[22814]: cluster 2024-09-13T05:43:40.905825+0000 mgr.y (mgr.14152) 14 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:42.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:41 smithi079 bash[22814]: cluster 2024-09-13T05:43:40.905825+0000 mgr.y (mgr.14152) 14 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:43.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:42 smithi079 bash[22814]: cluster 2024-09-13T05:43:42.906346+0000 mgr.y (mgr.14152) 15 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:43.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:42 smithi079 bash[22814]: cluster 2024-09-13T05:43:42.906346+0000 mgr.y (mgr.14152) 15 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:45.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:44 smithi079 bash[22814]: cluster 2024-09-13T05:43:44.906733+0000 mgr.y (mgr.14152) 16 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:45.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:44 smithi079 bash[22814]: cluster 2024-09-13T05:43:44.906733+0000 mgr.y (mgr.14152) 16 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:45.349 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T05:43:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1dad0bb640 1 -- 172.21.15.79:0/412924927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1da8104640 msgr2=0x7f1da8104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1dad0bb640 1 --2- 172.21.15.79:0/412924927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1da8104640 0x7f1da8104a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009880 tx=0x7f1d9802a5d0 comp rx=0 tx=0).stop 2024-09-13T05:43:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1dad0bb640 1 -- 172.21.15.79:0/412924927 shutdown_connections 2024-09-13T05:43:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1dad0bb640 1 --2- 172.21.15.79:0/412924927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1da8104640 0x7f1da8104a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1dad0bb640 1 -- 172.21.15.79:0/412924927 >> 172.21.15.79:0/412924927 conn(0x7f1da80fff30 msgr2=0x7f1da8102390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1dad0bb640 1 -- 172.21.15.79:0/412924927 shutdown_connections 2024-09-13T05:43:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1dad0bb640 1 -- 172.21.15.79:0/412924927 wait complete. 2024-09-13T05:43:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1dad0bb640 1 Processor -- start 2024-09-13T05:43:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1dad0bb640 1 -- start start 2024-09-13T05:43:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1dad0bb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1da8104640 0x7f1da8199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1dad0bb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1da8109d50 con 0x7f1da8104640 2024-09-13T05:43:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1da6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1da8104640 0x7f1da8199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1da6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1da8104640 0x7f1da8199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37566/0 (socket says 172.21.15.79:37566) 2024-09-13T05:43:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1da6d9d640 1 -- 172.21.15.79:0/1996560796 learned_addr learned my addr 172.21.15.79:0/1996560796 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.583+0000 7f1da6d9d640 1 -- 172.21.15.79:0/1996560796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da8199ad0 con 0x7f1da8104640 2024-09-13T05:43:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.587+0000 7f1da6d9d640 1 --2- 172.21.15.79:0/1996560796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1da8104640 0x7f1da8199570 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1d980057c0 tx=0x7f1d980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.587+0000 7f1d8ffff640 1 -- 172.21.15.79:0/1996560796 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d9803f070 con 0x7f1da8104640 2024-09-13T05:43:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.587+0000 7f1d8ffff640 1 -- 172.21.15.79:0/1996560796 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f1d98003ba0 con 0x7f1da8104640 2024-09-13T05:43:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.587+0000 7f1dad0bb640 1 -- 172.21.15.79:0/1996560796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da8199d60 con 0x7f1da8104640 2024-09-13T05:43:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.587+0000 7f1d8ffff640 1 -- 172.21.15.79:0/1996560796 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d98035030 con 0x7f1da8104640 2024-09-13T05:43:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.587+0000 7f1dad0bb640 1 -- 172.21.15.79:0/1996560796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da819a720 con 0x7f1da8104640 2024-09-13T05:43:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.587+0000 7f1dad0bb640 1 -- 172.21.15.79:0/1996560796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d940050b0 con 0x7f1da8104640 2024-09-13T05:43:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.587+0000 7f1d8ffff640 1 -- 172.21.15.79:0/1996560796 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) ==== 51786+0+0 (secure 0 0 0) 0x7f1d98042070 con 0x7f1da8104640 2024-09-13T05:43:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.587+0000 7f1d8ffff640 1 --2- 172.21.15.79:0/1996560796 >> v2:172.21.15.79:6800/614049769 conn(0x7f1d9003f750 0x7f1d90041c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.587+0000 7f1d8ffff640 1 -- 172.21.15.79:0/1996560796 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f1d98074ae0 con 0x7f1da8104640 2024-09-13T05:43:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.587+0000 7f1da659c640 1 --2- 172.21.15.79:0/1996560796 >> v2:172.21.15.79:6800/614049769 conn(0x7f1d9003f750 0x7f1d90041c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.587+0000 7f1da659c640 1 --2- 172.21.15.79:0/1996560796 >> v2:172.21.15.79:6800/614049769 conn(0x7f1d9003f750 0x7f1d90041c10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0098c0 tx=0x7f1d9c006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:46.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.591+0000 7f1d8ffff640 1 -- 172.21.15.79:0/1996560796 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f1d98039d40 con 0x7f1da8104640 2024-09-13T05:43:46.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.775+0000 7f1dad0bb640 1 -- 172.21.15.79:0/1996560796 --> v2:172.21.15.79:6800/614049769 -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f1d94000bf0 con 0x7f1d9003f750 2024-09-13T05:43:46.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.779+0000 7f1d8ffff640 1 -- 172.21.15.79:0/1996560796 <== mgr.14152 v2:172.21.15.79:6800/614049769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1d94000bf0 con 0x7f1d9003f750 2024-09-13T05:43:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.783+0000 7f1dad0bb640 1 -- 172.21.15.79:0/1996560796 >> v2:172.21.15.79:6800/614049769 conn(0x7f1d9003f750 msgr2=0x7f1d90041c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.783+0000 7f1dad0bb640 1 --2- 172.21.15.79:0/1996560796 >> v2:172.21.15.79:6800/614049769 conn(0x7f1d9003f750 0x7f1d90041c10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0098c0 tx=0x7f1d9c006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.783+0000 7f1dad0bb640 1 -- 172.21.15.79:0/1996560796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1da8104640 msgr2=0x7f1da8199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.783+0000 7f1dad0bb640 1 --2- 172.21.15.79:0/1996560796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1da8104640 0x7f1da8199570 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1d980057c0 tx=0x7f1d980048f0 comp rx=0 tx=0).stop 2024-09-13T05:43:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.783+0000 7f1dad0bb640 1 -- 172.21.15.79:0/1996560796 shutdown_connections 2024-09-13T05:43:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.783+0000 7f1dad0bb640 1 --2- 172.21.15.79:0/1996560796 >> v2:172.21.15.79:6800/614049769 conn(0x7f1d9003f750 0x7f1d90041c10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.783+0000 7f1dad0bb640 1 --2- 172.21.15.79:0/1996560796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1da8104640 0x7f1da8199570 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.783+0000 7f1dad0bb640 1 -- 172.21.15.79:0/1996560796 >> 172.21.15.79:0/1996560796 conn(0x7f1da80fff30 msgr2=0x7f1da8100ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.783+0000 7f1dad0bb640 1 -- 172.21.15.79:0/1996560796 shutdown_connections 2024-09-13T05:43:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:46.783+0000 7f1dad0bb640 1 -- 172.21.15.79:0/1996560796 wait complete. 2024-09-13T05:43:47.436 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi139 2024-09-13T05:43:47.436 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T05:43:47.436 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/etc/ceph/ceph.conf 2024-09-13T05:43:47.442 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T05:43:47.443 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:43:47.490 INFO:tasks.cephadm:Adding host smithi139 to orchestrator... 2024-09-13T05:43:47.490 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- ceph orch host add smithi139 2024-09-13T05:43:48.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:46.782292+0000 mgr.y (mgr.14152) 17 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:48.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:46.782292+0000 mgr.y (mgr.14152) 17 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:48.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:46.785151+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:48.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:46.785151+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:48.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:46.786340+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:43:48.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:46.786340+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:43:48.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:46.788722+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:43:48.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:46.788722+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:43:48.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:46.789766+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:43:48.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:46.789766+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:43:48.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: cephadm 2024-09-13T05:43:46.791478+0000 mgr.y (mgr.14152) 18 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.conf 2024-09-13T05:43:48.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: cephadm 2024-09-13T05:43:46.791478+0000 mgr.y (mgr.14152) 18 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.conf 2024-09-13T05:43:48.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: cephadm 2024-09-13T05:43:46.866094+0000 mgr.y (mgr.14152) 19 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:43:48.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: cephadm 2024-09-13T05:43:46.866094+0000 mgr.y (mgr.14152) 19 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:43:48.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: cluster 2024-09-13T05:43:46.906977+0000 mgr.y (mgr.14152) 20 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:48.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: cluster 2024-09-13T05:43:46.906977+0000 mgr.y (mgr.14152) 20 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:48.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:47.033192+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:48.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:47.033192+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:48.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:47.038146+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:48.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:47.038146+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:48.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:47.043652+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:48.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:47 smithi079 bash[22814]: audit 2024-09-13T05:43:47.043652+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:49.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:48 smithi079 bash[22814]: cephadm 2024-09-13T05:43:46.919451+0000 mgr.y (mgr.14152) 21 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:43:49.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:48 smithi079 bash[22814]: cephadm 2024-09-13T05:43:46.919451+0000 mgr.y (mgr.14152) 21 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:43:49.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:48 smithi079 bash[22814]: cephadm 2024-09-13T05:43:46.970867+0000 mgr.y (mgr.14152) 22 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T05:43:49.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:48 smithi079 bash[22814]: cephadm 2024-09-13T05:43:46.970867+0000 mgr.y (mgr.14152) 22 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T05:43:50.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:49 smithi079 bash[22814]: cluster 2024-09-13T05:43:48.907395+0000 mgr.y (mgr.14152) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:50.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:49 smithi079 bash[22814]: cluster 2024-09-13T05:43:48.907395+0000 mgr.y (mgr.14152) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:51.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:50 smithi079 bash[22814]: cluster 2024-09-13T05:43:50.907849+0000 mgr.y (mgr.14152) 24 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:51.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:50 smithi079 bash[22814]: cluster 2024-09-13T05:43:50.907849+0000 mgr.y (mgr.14152) 24 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:52.215 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T05:43:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.430+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/2167841605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a4101e00 msgr2=0x7fd8a41021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.430+0000 7fd8a9e2b640 1 --2- 172.21.15.79:0/2167841605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a4101e00 0x7fd8a41021e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd894009880 tx=0x7fd89402a5d0 comp rx=0 tx=0).stop 2024-09-13T05:43:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/2167841605 shutdown_connections 2024-09-13T05:43:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a9e2b640 1 --2- 172.21.15.79:0/2167841605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a4101e00 0x7fd8a41021e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/2167841605 >> 172.21.15.79:0/2167841605 conn(0x7fd8a40fc8a0 msgr2=0x7fd8a40fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/2167841605 shutdown_connections 2024-09-13T05:43:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/2167841605 wait complete. 2024-09-13T05:43:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a9e2b640 1 Processor -- start 2024-09-13T05:43:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a9e2b640 1 -- start start 2024-09-13T05:43:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a9e2b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a4101e00 0x7fd8a40fcda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:53.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a9e2b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a410b010 con 0x7fd8a4101e00 2024-09-13T05:43:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a4101e00 0x7fd8a40fcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a4101e00 0x7fd8a40fcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59464/0 (socket says 172.21.15.79:59464) 2024-09-13T05:43:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a37fe640 1 -- 172.21.15.79:0/1339588005 learned_addr learned my addr 172.21.15.79:0/1339588005 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:43:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a37fe640 1 -- 172.21.15.79:0/1339588005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a40feb40 con 0x7fd8a4101e00 2024-09-13T05:43:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a37fe640 1 --2- 172.21.15.79:0/1339588005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a4101e00 0x7fd8a40fcda0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd894005ab0 tx=0x7fd8940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a0ff9640 1 -- 172.21.15.79:0/1339588005 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd89403f070 con 0x7fd8a4101e00 2024-09-13T05:43:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/1339588005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a40fd2e0 con 0x7fd8a4101e00 2024-09-13T05:43:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a0ff9640 1 -- 172.21.15.79:0/1339588005 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fd894003a70 con 0x7fd8a4101e00 2024-09-13T05:43:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a0ff9640 1 -- 172.21.15.79:0/1339588005 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd894035030 con 0x7fd8a4101e00 2024-09-13T05:43:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/1339588005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a40fd7e0 con 0x7fd8a4101e00 2024-09-13T05:43:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a0ff9640 1 -- 172.21.15.79:0/1339588005 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) ==== 51786+0+0 (secure 0 0 0) 0x7fd894042070 con 0x7fd8a4101e00 2024-09-13T05:43:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/1339588005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a406abe0 con 0x7fd8a4101e00 2024-09-13T05:43:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a0ff9640 1 --2- 172.21.15.79:0/1339588005 >> v2:172.21.15.79:6800/614049769 conn(0x7fd88c03f700 0x7fd88c041bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:43:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a0ff9640 1 -- 172.21.15.79:0/1339588005 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fd894074b30 con 0x7fd8a4101e00 2024-09-13T05:43:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a2ffd640 1 --2- 172.21.15.79:0/1339588005 >> v2:172.21.15.79:6800/614049769 conn(0x7fd88c03f700 0x7fd88c041bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:43:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.434+0000 7fd8a2ffd640 1 --2- 172.21.15.79:0/1339588005 >> v2:172.21.15.79:6800/614049769 conn(0x7fd88c03f700 0x7fd88c041bc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd8980098c0 tx=0x7fd898006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:43:53.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.442+0000 7fd8a0ff9640 1 -- 172.21.15.79:0/1339588005 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7fd894036260 con 0x7fd8a4101e00 2024-09-13T05:43:53.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:53.626+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/1339588005 --> v2:172.21.15.79:6800/614049769 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}) -- 0x7fd8a40fe0a0 con 0x7fd88c03f700 2024-09-13T05:43:54.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:53 smithi079 bash[22814]: cluster 2024-09-13T05:43:52.908330+0000 mgr.y (mgr.14152) 25 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:54.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:53 smithi079 bash[22814]: cluster 2024-09-13T05:43:52.908330+0000 mgr.y (mgr.14152) 25 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:54.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:53 smithi079 bash[22814]: audit 2024-09-13T05:43:53.629634+0000 mgr.y (mgr.14152) 26 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:54.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:53 smithi079 bash[22814]: audit 2024-09-13T05:43:53.629634+0000 mgr.y (mgr.14152) 26 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:43:55.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:54 smithi079 bash[22814]: cephadm 2024-09-13T05:43:54.632781+0000 mgr.y (mgr.14152) 27 : cephadm [INF] Deploying cephadm binary to smithi139 2024-09-13T05:43:55.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:54 smithi079 bash[22814]: cephadm 2024-09-13T05:43:54.632781+0000 mgr.y (mgr.14152) 27 : cephadm [INF] Deploying cephadm binary to smithi139 2024-09-13T05:43:56.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:55 smithi079 bash[22814]: cluster 2024-09-13T05:43:54.908721+0000 mgr.y (mgr.14152) 28 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:56.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:55 smithi079 bash[22814]: cluster 2024-09-13T05:43:54.908721+0000 mgr.y (mgr.14152) 28 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:57.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:56 smithi079 bash[22814]: cluster 2024-09-13T05:43:56.908965+0000 mgr.y (mgr.14152) 29 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:57.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:56 smithi079 bash[22814]: cluster 2024-09-13T05:43:56.908965+0000 mgr.y (mgr.14152) 29 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:43:57.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:57.878+0000 7fd8a0ff9640 1 -- 172.21.15.79:0/1339588005 <== mgr.14152 v2:172.21.15.79:6800/614049769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd8a40fe0a0 con 0x7fd88c03f700 2024-09-13T05:43:57.879 INFO:teuthology.orchestra.run.smithi079.stdout:Added host 'smithi139' with addr '172.21.15.139' 2024-09-13T05:43:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:57.882+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/1339588005 >> v2:172.21.15.79:6800/614049769 conn(0x7fd88c03f700 msgr2=0x7fd88c041bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:57.882+0000 7fd8a9e2b640 1 --2- 172.21.15.79:0/1339588005 >> v2:172.21.15.79:6800/614049769 conn(0x7fd88c03f700 0x7fd88c041bc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd8980098c0 tx=0x7fd898006db0 comp rx=0 tx=0).stop 2024-09-13T05:43:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:57.882+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/1339588005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a4101e00 msgr2=0x7fd8a40fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:43:57.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:57.882+0000 7fd8a9e2b640 1 --2- 172.21.15.79:0/1339588005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a4101e00 0x7fd8a40fcda0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd894005ab0 tx=0x7fd8940048f0 comp rx=0 tx=0).stop 2024-09-13T05:43:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:57.882+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/1339588005 shutdown_connections 2024-09-13T05:43:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:57.882+0000 7fd8a9e2b640 1 --2- 172.21.15.79:0/1339588005 >> v2:172.21.15.79:6800/614049769 conn(0x7fd88c03f700 0x7fd88c041bc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:57.882+0000 7fd8a9e2b640 1 --2- 172.21.15.79:0/1339588005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a4101e00 0x7fd8a40fcda0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:43:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:57.882+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/1339588005 >> 172.21.15.79:0/1339588005 conn(0x7fd8a40fc8a0 msgr2=0x7fd8a41012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:43:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:57.882+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/1339588005 shutdown_connections 2024-09-13T05:43:57.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:43:57.882+0000 7fd8a9e2b640 1 -- 172.21.15.79:0/1339588005 wait complete. 2024-09-13T05:43:58.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T05:43:59.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:58 smithi079 bash[22814]: audit 2024-09-13T05:43:57.878163+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:59.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:58 smithi079 bash[22814]: audit 2024-09-13T05:43:57.878163+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:59.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:58 smithi079 bash[22814]: cephadm 2024-09-13T05:43:57.879027+0000 mgr.y (mgr.14152) 30 : cephadm [INF] Added host smithi139 2024-09-13T05:43:59.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:58 smithi079 bash[22814]: cephadm 2024-09-13T05:43:57.879027+0000 mgr.y (mgr.14152) 30 : cephadm [INF] Added host smithi139 2024-09-13T05:43:59.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:58 smithi079 bash[22814]: audit 2024-09-13T05:43:57.879932+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:43:59.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:58 smithi079 bash[22814]: audit 2024-09-13T05:43:57.879932+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:43:59.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:58 smithi079 bash[22814]: audit 2024-09-13T05:43:58.373490+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:43:59.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:58 smithi079 bash[22814]: audit 2024-09-13T05:43:58.373490+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:00.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:59 smithi079 bash[22814]: cluster 2024-09-13T05:43:58.909295+0000 mgr.y (mgr.14152) 31 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:00.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:43:59 smithi079 bash[22814]: cluster 2024-09-13T05:43:58.909295+0000 mgr.y (mgr.14152) 31 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:01.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:00 smithi079 bash[22814]: audit 2024-09-13T05:43:59.914938+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:01.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:00 smithi079 bash[22814]: audit 2024-09-13T05:43:59.914938+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:02.488 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:02 smithi079 bash[22814]: cluster 2024-09-13T05:44:00.909719+0000 mgr.y (mgr.14152) 32 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:02.489 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:02 smithi079 bash[22814]: cluster 2024-09-13T05:44:00.909719+0000 mgr.y (mgr.14152) 32 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:02.489 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:02 smithi079 bash[22814]: audit 2024-09-13T05:44:01.074314+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:02.489 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:02 smithi079 bash[22814]: audit 2024-09-13T05:44:01.074314+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:03.286 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T05:44:04.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.406+0000 7ff1de95d640 1 -- 172.21.15.79:0/390328706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d8103670 msgr2=0x7ff1d8103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:04.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.406+0000 7ff1de95d640 1 --2- 172.21.15.79:0/390328706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d8103670 0x7ff1d8103a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009880 tx=0x7ff1d002a5d0 comp rx=0 tx=0).stop 2024-09-13T05:44:04.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.406+0000 7ff1de95d640 1 -- 172.21.15.79:0/390328706 shutdown_connections 2024-09-13T05:44:04.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.406+0000 7ff1de95d640 1 --2- 172.21.15.79:0/390328706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d8103670 0x7ff1d8103a50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:04.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.406+0000 7ff1de95d640 1 -- 172.21.15.79:0/390328706 >> 172.21.15.79:0/390328706 conn(0x7ff1d80fd0b0 msgr2=0x7ff1d80ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:04.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.406+0000 7ff1de95d640 1 -- 172.21.15.79:0/390328706 shutdown_connections 2024-09-13T05:44:04.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.406+0000 7ff1de95d640 1 -- 172.21.15.79:0/390328706 wait complete. 2024-09-13T05:44:04.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1de95d640 1 Processor -- start 2024-09-13T05:44:04.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1de95d640 1 -- start start 2024-09-13T05:44:04.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1de95d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d8103670 0x7ff1d8101320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:04.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1de95d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d810c120 con 0x7ff1d8103670 2024-09-13T05:44:04.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d8103670 0x7ff1d8101320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:04.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d8103670 0x7ff1d8101320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51086/0 (socket says 172.21.15.79:51086) 2024-09-13T05:44:04.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1d7fff640 1 -- 172.21.15.79:0/1940240906 learned_addr learned my addr 172.21.15.79:0/1940240906 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:44:04.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1d7fff640 1 -- 172.21.15.79:0/1940240906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d81030c0 con 0x7ff1d8103670 2024-09-13T05:44:04.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1d7fff640 1 --2- 172.21.15.79:0/1940240906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d8103670 0x7ff1d8101320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00099a0 tx=0x7ff1d00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:04.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1d57fa640 1 -- 172.21.15.79:0/1940240906 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d003f070 con 0x7ff1d8103670 2024-09-13T05:44:04.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1de95d640 1 -- 172.21.15.79:0/1940240906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d8101860 con 0x7ff1d8103670 2024-09-13T05:44:04.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1d57fa640 1 -- 172.21.15.79:0/1940240906 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7ff1d0003a70 con 0x7ff1d8103670 2024-09-13T05:44:04.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1d57fa640 1 -- 172.21.15.79:0/1940240906 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d0035030 con 0x7ff1d8103670 2024-09-13T05:44:04.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1de95d640 1 -- 172.21.15.79:0/1940240906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d8101de0 con 0x7ff1d8103670 2024-09-13T05:44:04.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1de95d640 1 -- 172.21.15.79:0/1940240906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d806b530 con 0x7ff1d8103670 2024-09-13T05:44:04.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1d57fa640 1 -- 172.21.15.79:0/1940240906 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) ==== 51786+0+0 (secure 0 0 0) 0x7ff1d0042070 con 0x7ff1d8103670 2024-09-13T05:44:04.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1d57fa640 1 --2- 172.21.15.79:0/1940240906 >> v2:172.21.15.79:6800/614049769 conn(0x7ff1c403f700 0x7ff1c4041bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:04.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1d57fa640 1 -- 172.21.15.79:0/1940240906 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7ff1d0074a20 con 0x7ff1d8103670 2024-09-13T05:44:04.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1d77fe640 1 --2- 172.21.15.79:0/1940240906 >> v2:172.21.15.79:6800/614049769 conn(0x7ff1c403f700 0x7ff1c4041bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:04.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.410+0000 7ff1d77fe640 1 --2- 172.21.15.79:0/1940240906 >> v2:172.21.15.79:6800/614049769 conn(0x7ff1c403f700 0x7ff1c4041bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00098c0 tx=0x7ff1c0006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:04.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.414+0000 7ff1d57fa640 1 -- 172.21.15.79:0/1940240906 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7ff1d004c350 con 0x7ff1d8103670 2024-09-13T05:44:04.488 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:04 smithi079 bash[22814]: cluster 2024-09-13T05:44:02.910097+0000 mgr.y (mgr.14152) 33 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:04.488 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:04 smithi079 bash[22814]: cluster 2024-09-13T05:44:02.910097+0000 mgr.y (mgr.14152) 33 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.606+0000 7ff1de95d640 1 -- 172.21.15.79:0/1940240906 --> v2:172.21.15.79:6800/614049769 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff1d8103ad0 con 0x7ff1c403f700 2024-09-13T05:44:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.610+0000 7ff1d57fa640 1 -- 172.21.15.79:0/1940240906 <== mgr.14152 v2:172.21.15.79:6800/614049769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7ff1d8103ad0 con 0x7ff1c403f700 2024-09-13T05:44:04.612 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-13T05:44:04.612 INFO:teuthology.orchestra.run.smithi079.stdout:[{"addr": "172.21.15.79", "hostname": "smithi079", "labels": [], "status": ""}, {"addr": "172.21.15.139", "hostname": "smithi139", "labels": [], "status": ""}] 2024-09-13T05:44:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.610+0000 7ff1de95d640 1 -- 172.21.15.79:0/1940240906 >> v2:172.21.15.79:6800/614049769 conn(0x7ff1c403f700 msgr2=0x7ff1c4041bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.610+0000 7ff1de95d640 1 --2- 172.21.15.79:0/1940240906 >> v2:172.21.15.79:6800/614049769 conn(0x7ff1c403f700 0x7ff1c4041bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00098c0 tx=0x7ff1c0006db0 comp rx=0 tx=0).stop 2024-09-13T05:44:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.610+0000 7ff1de95d640 1 -- 172.21.15.79:0/1940240906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d8103670 msgr2=0x7ff1d8101320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.610+0000 7ff1de95d640 1 --2- 172.21.15.79:0/1940240906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d8103670 0x7ff1d8101320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00099a0 tx=0x7ff1d00048f0 comp rx=0 tx=0).stop 2024-09-13T05:44:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.610+0000 7ff1de95d640 1 -- 172.21.15.79:0/1940240906 shutdown_connections 2024-09-13T05:44:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.610+0000 7ff1de95d640 1 --2- 172.21.15.79:0/1940240906 >> v2:172.21.15.79:6800/614049769 conn(0x7ff1c403f700 0x7ff1c4041bc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.610+0000 7ff1de95d640 1 --2- 172.21.15.79:0/1940240906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1d8103670 0x7ff1d8101320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.610+0000 7ff1de95d640 1 -- 172.21.15.79:0/1940240906 >> 172.21.15.79:0/1940240906 conn(0x7ff1d80fd0b0 msgr2=0x7ff1d8106bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.610+0000 7ff1de95d640 1 -- 172.21.15.79:0/1940240906 shutdown_connections 2024-09-13T05:44:04.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:04.610+0000 7ff1de95d640 1 -- 172.21.15.79:0/1940240906 wait complete. 2024-09-13T05:44:05.231 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T05:44:05.232 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T05:44:05.488 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:05 smithi079 bash[22814]: audit 2024-09-13T05:44:04.611656+0000 mgr.y (mgr.14152) 34 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T05:44:05.488 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:05 smithi079 bash[22814]: audit 2024-09-13T05:44:04.611656+0000 mgr.y (mgr.14152) 34 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T05:44:05.488 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:05 smithi079 bash[22814]: cluster 2024-09-13T05:44:04.910470+0000 mgr.y (mgr.14152) 35 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:05.489 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:05 smithi079 bash[22814]: cluster 2024-09-13T05:44:04.910470+0000 mgr.y (mgr.14152) 35 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:07.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.399856+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:07.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.399856+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:07.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.407612+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:07.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.407612+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:07.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.416098+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:07.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.416098+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:07.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.423480+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:07.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.423480+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:07.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.425148+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"} : dispatch 2024-09-13T05:44:07.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.425148+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"} : dispatch 2024-09-13T05:44:07.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.427153+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:07.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.427153+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:07.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.428949+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:07.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.428949+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:07.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: cephadm 2024-09-13T05:44:06.431444+0000 mgr.y (mgr.14152) 36 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T05:44:07.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: cephadm 2024-09-13T05:44:06.431444+0000 mgr.y (mgr.14152) 36 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T05:44:07.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: cephadm 2024-09-13T05:44:06.543603+0000 mgr.y (mgr.14152) 37 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:07.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: cephadm 2024-09-13T05:44:06.543603+0000 mgr.y (mgr.14152) 37 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:07.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: cephadm 2024-09-13T05:44:06.640665+0000 mgr.y (mgr.14152) 38 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:44:07.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: cephadm 2024-09-13T05:44:06.640665+0000 mgr.y (mgr.14152) 38 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:44:07.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: cephadm 2024-09-13T05:44:06.729852+0000 mgr.y (mgr.14152) 39 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T05:44:07.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: cephadm 2024-09-13T05:44:06.729852+0000 mgr.y (mgr.14152) 39 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T05:44:07.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.824033+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:07.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.824033+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:07.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.831932+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:07.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.831932+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:07.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.840249+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:07.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:07 smithi079 bash[22814]: audit 2024-09-13T05:44:06.840249+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:08.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:08 smithi079 bash[22814]: cluster 2024-09-13T05:44:06.910925+0000 mgr.y (mgr.14152) 40 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:08.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:08 smithi079 bash[22814]: cluster 2024-09-13T05:44:06.910925+0000 mgr.y (mgr.14152) 40 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:09.961 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T05:44:10.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:10 smithi079 bash[22814]: cluster 2024-09-13T05:44:08.911296+0000 mgr.y (mgr.14152) 41 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:10.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:10 smithi079 bash[22814]: cluster 2024-09-13T05:44:08.911296+0000 mgr.y (mgr.14152) 41 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:11.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.198+0000 7f7fd36f2640 1 -- 172.21.15.79:0/1596474822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fcc101680 msgr2=0x7f7fcc101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:11.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.198+0000 7f7fd36f2640 1 --2- 172.21.15.79:0/1596474822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fcc101680 0x7f7fcc101a60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009880 tx=0x7f7fc802a5d0 comp rx=0 tx=0).stop 2024-09-13T05:44:11.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.198+0000 7f7fd36f2640 1 -- 172.21.15.79:0/1596474822 shutdown_connections 2024-09-13T05:44:11.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.198+0000 7f7fd36f2640 1 --2- 172.21.15.79:0/1596474822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fcc101680 0x7f7fcc101a60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:11.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.198+0000 7f7fd36f2640 1 -- 172.21.15.79:0/1596474822 >> 172.21.15.79:0/1596474822 conn(0x7f7fcc0fd0f0 msgr2=0x7f7fcc0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:11.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.198+0000 7f7fd36f2640 1 -- 172.21.15.79:0/1596474822 shutdown_connections 2024-09-13T05:44:11.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.198+0000 7f7fd36f2640 1 -- 172.21.15.79:0/1596474822 wait complete. 2024-09-13T05:44:11.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fd36f2640 1 Processor -- start 2024-09-13T05:44:11.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fd36f2640 1 -- start start 2024-09-13T05:44:11.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fd36f2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fcc101680 0x7f7fcc197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:11.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fd36f2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc10afe0 con 0x7f7fcc101680 2024-09-13T05:44:11.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fd148e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fcc101680 0x7f7fcc197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:11.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fd148e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fcc101680 0x7f7fcc197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51102/0 (socket says 172.21.15.79:51102) 2024-09-13T05:44:11.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fd148e640 1 -- 172.21.15.79:0/3645385921 learned_addr learned my addr 172.21.15.79:0/3645385921 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:44:11.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fd148e640 1 -- 172.21.15.79:0/3645385921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc197c40 con 0x7f7fcc101680 2024-09-13T05:44:11.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fd148e640 1 --2- 172.21.15.79:0/3645385921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fcc101680 0x7f7fcc197700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8005ab0 tx=0x7f7fc80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:11.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fc27fc640 1 -- 172.21.15.79:0/3645385921 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc803f070 con 0x7f7fcc101680 2024-09-13T05:44:11.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fc27fc640 1 -- 172.21.15.79:0/3645385921 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f7fc8003a70 con 0x7f7fcc101680 2024-09-13T05:44:11.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fd36f2640 1 -- 172.21.15.79:0/3645385921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fcc197f30 con 0x7f7fcc101680 2024-09-13T05:44:11.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fc27fc640 1 -- 172.21.15.79:0/3645385921 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc8035030 con 0x7f7fcc101680 2024-09-13T05:44:11.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fd36f2640 1 -- 172.21.15.79:0/3645385921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fcc19cfe0 con 0x7f7fcc101680 2024-09-13T05:44:11.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fd36f2640 1 -- 172.21.15.79:0/3645385921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fcc102930 con 0x7f7fcc101680 2024-09-13T05:44:11.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fc27fc640 1 -- 172.21.15.79:0/3645385921 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) ==== 51786+0+0 (secure 0 0 0) 0x7f7fc8042070 con 0x7f7fcc101680 2024-09-13T05:44:11.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fc27fc640 1 --2- 172.21.15.79:0/3645385921 >> v2:172.21.15.79:6800/614049769 conn(0x7f7fb803f750 0x7f7fb8041c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:11.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fc27fc640 1 -- 172.21.15.79:0/3645385921 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f7fc80749e0 con 0x7f7fcc101680 2024-09-13T05:44:11.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fd0c8d640 1 --2- 172.21.15.79:0/3645385921 >> v2:172.21.15.79:6800/614049769 conn(0x7f7fb803f750 0x7f7fb8041c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:11.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.202+0000 7f7fd0c8d640 1 --2- 172.21.15.79:0/3645385921 >> v2:172.21.15.79:6800/614049769 conn(0x7f7fb803f750 0x7f7fb8041c10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0098c0 tx=0x7f7fbc006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:11.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.210+0000 7f7fc27fc640 1 -- 172.21.15.79:0/3645385921 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f7fc8041e00 con 0x7f7fcc101680 2024-09-13T05:44:11.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.394+0000 7f7fd36f2640 1 -- 172.21.15.79:0/3645385921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7fcc101ae0 con 0x7f7fcc101680 2024-09-13T05:44:11.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.406+0000 7f7fc27fc640 1 -- 172.21.15.79:0/3645385921 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f7fc80035f0 con 0x7f7fcc101680 2024-09-13T05:44:11.409 INFO:teuthology.orchestra.run.smithi079.stderr:adjusted tunables profile to default 2024-09-13T05:44:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.410+0000 7f7fd36f2640 1 -- 172.21.15.79:0/3645385921 >> v2:172.21.15.79:6800/614049769 conn(0x7f7fb803f750 msgr2=0x7f7fb8041c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.410+0000 7f7fd36f2640 1 --2- 172.21.15.79:0/3645385921 >> v2:172.21.15.79:6800/614049769 conn(0x7f7fb803f750 0x7f7fb8041c10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0098c0 tx=0x7f7fbc006db0 comp rx=0 tx=0).stop 2024-09-13T05:44:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.410+0000 7f7fd36f2640 1 -- 172.21.15.79:0/3645385921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fcc101680 msgr2=0x7f7fcc197700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.410+0000 7f7fd36f2640 1 --2- 172.21.15.79:0/3645385921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fcc101680 0x7f7fcc197700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8005ab0 tx=0x7f7fc80048f0 comp rx=0 tx=0).stop 2024-09-13T05:44:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.410+0000 7f7fd36f2640 1 -- 172.21.15.79:0/3645385921 shutdown_connections 2024-09-13T05:44:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.410+0000 7f7fd36f2640 1 --2- 172.21.15.79:0/3645385921 >> v2:172.21.15.79:6800/614049769 conn(0x7f7fb803f750 0x7f7fb8041c10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.410+0000 7f7fd36f2640 1 --2- 172.21.15.79:0/3645385921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fcc101680 0x7f7fcc197700 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.410+0000 7f7fd36f2640 1 -- 172.21.15.79:0/3645385921 >> 172.21.15.79:0/3645385921 conn(0x7f7fcc0fd0f0 msgr2=0x7f7fcc06b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.410+0000 7f7fd36f2640 1 -- 172.21.15.79:0/3645385921 shutdown_connections 2024-09-13T05:44:11.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:11.410+0000 7f7fd36f2640 1 -- 172.21.15.79:0/3645385921 wait complete. 2024-09-13T05:44:11.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:11 smithi079 bash[22814]: audit 2024-09-13T05:44:11.397337+0000 mon.a (mon.0) 132 : audit [INF] from='client.? 172.21.15.79:0/3645385921' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-13T05:44:11.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:11 smithi079 bash[22814]: audit 2024-09-13T05:44:11.397337+0000 mon.a (mon.0) 132 : audit [INF] from='client.? 172.21.15.79:0/3645385921' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-13T05:44:11.990 INFO:tasks.cephadm:Adding mon.a on smithi079 2024-09-13T05:44:11.990 INFO:tasks.cephadm:Adding mon.c on smithi079 2024-09-13T05:44:11.990 INFO:tasks.cephadm:Adding mon.b on smithi139 2024-09-13T05:44:11.990 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi079:172.21.15.79=a;smithi079:[v2:172.21.15.79:3301,v1:172.21.15.79:6790]=c;smithi139:172.21.15.139=b' 2024-09-13T05:44:12.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:12 smithi079 bash[22814]: cluster 2024-09-13T05:44:10.911705+0000 mgr.y (mgr.14152) 42 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:12.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:12 smithi079 bash[22814]: cluster 2024-09-13T05:44:10.911705+0000 mgr.y (mgr.14152) 42 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:12.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:12 smithi079 bash[22814]: audit 2024-09-13T05:44:11.409502+0000 mon.a (mon.0) 133 : audit [INF] from='client.? 172.21.15.79:0/3645385921' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T05:44:12.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:12 smithi079 bash[22814]: audit 2024-09-13T05:44:11.409502+0000 mon.a (mon.0) 133 : audit [INF] from='client.? 172.21.15.79:0/3645385921' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T05:44:12.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:12 smithi079 bash[22814]: cluster 2024-09-13T05:44:11.414062+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:12.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:12 smithi079 bash[22814]: cluster 2024-09-13T05:44:11.414062+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:13.221 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:14.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.501+0000 7f5f68037640 1 -- 172.21.15.139:0/2615682652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f601084b0 msgr2=0x7f5f60108890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:14.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.501+0000 7f5f68037640 1 --2- 172.21.15.139:0/2615682652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f601084b0 0x7f5f60108890 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009880 tx=0x7f5f5c02a670 comp rx=0 tx=0).stop 2024-09-13T05:44:14.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.501+0000 7f5f68037640 1 -- 172.21.15.139:0/2615682652 shutdown_connections 2024-09-13T05:44:14.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.501+0000 7f5f68037640 1 --2- 172.21.15.139:0/2615682652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f601084b0 0x7f5f60108890 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:14.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.501+0000 7f5f68037640 1 -- 172.21.15.139:0/2615682652 >> 172.21.15.139:0/2615682652 conn(0x7f5f60078210 msgr2=0x7f5f60078620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:14.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.501+0000 7f5f68037640 1 -- 172.21.15.139:0/2615682652 shutdown_connections 2024-09-13T05:44:14.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.501+0000 7f5f68037640 1 -- 172.21.15.139:0/2615682652 wait complete. 2024-09-13T05:44:14.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.501+0000 7f5f68037640 1 Processor -- start 2024-09-13T05:44:14.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.501+0000 7f5f68037640 1 -- start start 2024-09-13T05:44:14.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.501+0000 7f5f68037640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f601084b0 0x7f5f60197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:14.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.501+0000 7f5f68037640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6010c0e0 con 0x7f5f601084b0 2024-09-13T05:44:14.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.501+0000 7f5f65dd3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f601084b0 0x7f5f60197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:14.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.501+0000 7f5f65dd3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f601084b0 0x7f5f60197680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.139:58904/0 (socket says 172.21.15.139:58904) 2024-09-13T05:44:14.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.501+0000 7f5f65dd3640 1 -- 172.21.15.139:0/957658455 learned_addr learned my addr 172.21.15.139:0/957658455 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T05:44:14.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.505+0000 7f5f65dd3640 1 -- 172.21.15.139:0/957658455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f60197bc0 con 0x7f5f601084b0 2024-09-13T05:44:14.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.505+0000 7f5f65dd3640 1 --2- 172.21.15.139:0/957658455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f601084b0 0x7f5f60197680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c005ab0 tx=0x7f5f5c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:14.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.505+0000 7f5f56ffd640 1 -- 172.21.15.139:0/957658455 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f5c03f070 con 0x7f5f601084b0 2024-09-13T05:44:14.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.505+0000 7f5f68037640 1 -- 172.21.15.139:0/957658455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f60197eb0 con 0x7f5f601084b0 2024-09-13T05:44:14.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.505+0000 7f5f68037640 1 -- 172.21.15.139:0/957658455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6019cf60 con 0x7f5f601084b0 2024-09-13T05:44:14.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.505+0000 7f5f56ffd640 1 -- 172.21.15.139:0/957658455 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f5f5c003a70 con 0x7f5f601084b0 2024-09-13T05:44:14.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.505+0000 7f5f56ffd640 1 -- 172.21.15.139:0/957658455 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f5c035030 con 0x7f5f601084b0 2024-09-13T05:44:14.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.505+0000 7f5f68037640 1 -- 172.21.15.139:0/957658455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f440050b0 con 0x7f5f601084b0 2024-09-13T05:44:14.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.505+0000 7f5f56ffd640 1 -- 172.21.15.139:0/957658455 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) ==== 51786+0+0 (secure 0 0 0) 0x7f5f5c042070 con 0x7f5f601084b0 2024-09-13T05:44:14.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.505+0000 7f5f56ffd640 1 --2- 172.21.15.139:0/957658455 >> v2:172.21.15.79:6800/614049769 conn(0x7f5f4c03f750 0x7f5f4c041c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:14.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.505+0000 7f5f56ffd640 1 -- 172.21.15.139:0/957658455 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f5f5c074d10 con 0x7f5f601084b0 2024-09-13T05:44:14.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.505+0000 7f5f655d2640 1 --2- 172.21.15.139:0/957658455 >> v2:172.21.15.79:6800/614049769 conn(0x7f5f4c03f750 0x7f5f4c041c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:14.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.505+0000 7f5f655d2640 1 --2- 172.21.15.139:0/957658455 >> v2:172.21.15.79:6800/614049769 conn(0x7f5f4c03f750 0x7f5f4c041c10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5f500098c0 tx=0x7f5f50006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:14.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.521+0000 7f5f56ffd640 1 -- 172.21.15.139:0/957658455 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f5f5c073740 con 0x7f5f601084b0 2024-09-13T05:44:14.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.713+0000 7f5f68037640 1 -- 172.21.15.139:0/957658455 --> v2:172.21.15.79:6800/614049769 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi079:172.21.15.79=a;smithi079:[v2:172.21.15.79:3301,v1:172.21.15.79:6790]=c;smithi139:172.21.15.139=b", "target": ["mon-mgr", ""]}) -- 0x7f5f44000cc0 con 0x7f5f4c03f750 2024-09-13T05:44:14.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.729+0000 7f5f56ffd640 1 -- 172.21.15.139:0/957658455 <== mgr.14152 v2:172.21.15.79:6800/614049769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5f44000cc0 con 0x7f5f4c03f750 2024-09-13T05:44:14.731 INFO:teuthology.orchestra.run.smithi139.stdout:Scheduled mon update... 2024-09-13T05:44:14.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.729+0000 7f5f68037640 1 -- 172.21.15.139:0/957658455 >> v2:172.21.15.79:6800/614049769 conn(0x7f5f4c03f750 msgr2=0x7f5f4c041c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:14.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.729+0000 7f5f68037640 1 --2- 172.21.15.139:0/957658455 >> v2:172.21.15.79:6800/614049769 conn(0x7f5f4c03f750 0x7f5f4c041c10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5f500098c0 tx=0x7f5f50006db0 comp rx=0 tx=0).stop 2024-09-13T05:44:14.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.729+0000 7f5f68037640 1 -- 172.21.15.139:0/957658455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f601084b0 msgr2=0x7f5f60197680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:14.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.729+0000 7f5f68037640 1 --2- 172.21.15.139:0/957658455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f601084b0 0x7f5f60197680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c005ab0 tx=0x7f5f5c0048f0 comp rx=0 tx=0).stop 2024-09-13T05:44:14.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.729+0000 7f5f68037640 1 -- 172.21.15.139:0/957658455 shutdown_connections 2024-09-13T05:44:14.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.729+0000 7f5f68037640 1 --2- 172.21.15.139:0/957658455 >> v2:172.21.15.79:6800/614049769 conn(0x7f5f4c03f750 0x7f5f4c041c10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:14.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.729+0000 7f5f68037640 1 --2- 172.21.15.139:0/957658455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f601084b0 0x7f5f60197680 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:14.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.729+0000 7f5f68037640 1 -- 172.21.15.139:0/957658455 >> 172.21.15.139:0/957658455 conn(0x7f5f60078210 msgr2=0x7f5f601047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:14.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.729+0000 7f5f68037640 1 -- 172.21.15.139:0/957658455 shutdown_connections 2024-09-13T05:44:14.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:14.729+0000 7f5f68037640 1 -- 172.21.15.139:0/957658455 wait complete. 2024-09-13T05:44:14.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:14 smithi079 bash[22814]: cluster 2024-09-13T05:44:12.912144+0000 mgr.y (mgr.14152) 43 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:14.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:14 smithi079 bash[22814]: cluster 2024-09-13T05:44:12.912144+0000 mgr.y (mgr.14152) 43 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:15.200 DEBUG:teuthology.orchestra.run.smithi079:mon.c> sudo journalctl -f -n 0 -u ceph-bf551932-7192-11ef-bceb-c7b262605968@mon.c.service 2024-09-13T05:44:15.203 DEBUG:teuthology.orchestra.run.smithi139:mon.b> sudo journalctl -f -n 0 -u ceph-bf551932-7192-11ef-bceb-c7b262605968@mon.b.service 2024-09-13T05:44:15.205 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T05:44:15.205 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T05:44:15.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.718851+0000 mgr.y (mgr.14152) 44 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi079:172.21.15.79=a;smithi079:[v2:172.21.15.79:3301,v1:172.21.15.79:6790]=c;smithi139:172.21.15.139=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:15.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.718851+0000 mgr.y (mgr.14152) 44 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi079:172.21.15.79=a;smithi079:[v2:172.21.15.79:3301,v1:172.21.15.79:6790]=c;smithi139:172.21.15.139=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:15.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: cephadm 2024-09-13T05:44:14.724160+0000 mgr.y (mgr.14152) 45 : cephadm [INF] Saving service mon spec with placement smithi079:172.21.15.79=a;smithi079:[v2:172.21.15.79:3301,v1:172.21.15.79:6790]=c;smithi139:172.21.15.139=b;count:3 2024-09-13T05:44:15.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: cephadm 2024-09-13T05:44:14.724160+0000 mgr.y (mgr.14152) 45 : cephadm [INF] Saving service mon spec with placement smithi079:172.21.15.79=a;smithi079:[v2:172.21.15.79:3301,v1:172.21.15.79:6790]=c;smithi139:172.21.15.139=b;count:3 2024-09-13T05:44:15.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.729858+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:15.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.729858+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:15.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.731490+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:15.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.731490+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:15.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.734749+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:15.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.734749+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:15.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.736384+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:15.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.736384+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:15.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.744795+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:15.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.744795+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:15.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.748581+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:15.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.748581+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:15.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.750292+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:15.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: audit 2024-09-13T05:44:14.750292+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:15.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: cephadm 2024-09-13T05:44:14.752148+0000 mgr.y (mgr.14152) 46 : cephadm [INF] Deploying daemon mon.b on smithi139 2024-09-13T05:44:15.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:15 smithi079 bash[22814]: cephadm 2024-09-13T05:44:14.752148+0000 mgr.y (mgr.14152) 46 : cephadm [INF] Deploying daemon mon.b on smithi139 2024-09-13T05:44:16.448 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:16 smithi079 bash[22814]: cluster 2024-09-13T05:44:14.912637+0000 mgr.y (mgr.14152) 47 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:17.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:16 smithi079 bash[22814]: cluster 2024-09-13T05:44:14.912637+0000 mgr.y (mgr.14152) 47 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:17.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.917+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/3372759227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc076f00 msgr2=0x7fa8cc075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:17.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.917+0000 7fa8d0dcb640 1 --2- 172.21.15.139:0/3372759227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc076f00 0x7fa8cc075380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009880 tx=0x7fa8b402a5d0 comp rx=0 tx=0).stop 2024-09-13T05:44:17.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.917+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/3372759227 shutdown_connections 2024-09-13T05:44:17.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.917+0000 7fa8d0dcb640 1 --2- 172.21.15.139:0/3372759227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc076f00 0x7fa8cc075380 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:17.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.917+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/3372759227 >> 172.21.15.139:0/3372759227 conn(0x7fa8cc078270 msgr2=0x7fa8cc078680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:17.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.917+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/3372759227 shutdown_connections 2024-09-13T05:44:17.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.917+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/3372759227 wait complete. 2024-09-13T05:44:17.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8d0dcb640 1 Processor -- start 2024-09-13T05:44:17.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8d0dcb640 1 -- start start 2024-09-13T05:44:17.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8d0dcb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc076f00 0x7fa8cc19dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:17.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8d0dcb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa8cc112730 con 0x7fa8cc076f00 2024-09-13T05:44:17.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8ca59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc076f00 0x7fa8cc19dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:17.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8ca59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc076f00 0x7fa8cc19dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.139:58916/0 (socket says 172.21.15.139:58916) 2024-09-13T05:44:17.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8ca59c640 1 -- 172.21.15.139:0/818588400 learned_addr learned my addr 172.21.15.139:0/818588400 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T05:44:17.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8ca59c640 1 -- 172.21.15.139:0/818588400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8cc19e1f0 con 0x7fa8cc076f00 2024-09-13T05:44:17.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8ca59c640 1 --2- 172.21.15.139:0/818588400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc076f00 0x7fa8cc19dcb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40099a0 tx=0x7fa8b40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:17.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8c37fe640 1 -- 172.21.15.139:0/818588400 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8b403f070 con 0x7fa8cc076f00 2024-09-13T05:44:17.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/818588400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8cc19e480 con 0x7fa8cc076f00 2024-09-13T05:44:17.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/818588400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8cc1a3590 con 0x7fa8cc076f00 2024-09-13T05:44:17.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8c37fe640 1 -- 172.21.15.139:0/818588400 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fa8b40054c0 con 0x7fa8cc076f00 2024-09-13T05:44:17.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8c37fe640 1 -- 172.21.15.139:0/818588400 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8b4049060 con 0x7fa8cc076f00 2024-09-13T05:44:17.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/818588400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8ac0050b0 con 0x7fa8cc076f00 2024-09-13T05:44:17.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.921+0000 7fa8c37fe640 1 -- 172.21.15.139:0/818588400 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) ==== 51786+0+0 (secure 0 0 0) 0x7fa8b4042070 con 0x7fa8cc076f00 2024-09-13T05:44:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.925+0000 7fa8c37fe640 1 --2- 172.21.15.139:0/818588400 >> v2:172.21.15.79:6800/614049769 conn(0x7fa8b803f700 0x7fa8b8041bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.925+0000 7fa8c37fe640 1 -- 172.21.15.139:0/818588400 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7fa8b40749b0 con 0x7fa8cc076f00 2024-09-13T05:44:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.925+0000 7fa8c3fff640 1 --2- 172.21.15.139:0/818588400 >> v2:172.21.15.79:6800/614049769 conn(0x7fa8b803f700 0x7fa8b8041bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:17.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.925+0000 7fa8c3fff640 1 --2- 172.21.15.139:0/818588400 >> v2:172.21.15.79:6800/614049769 conn(0x7fa8b803f700 0x7fa8b8041bc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0098c0 tx=0x7fa8bc006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:17.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:17.937+0000 7fa8c37fe640 1 -- 172.21.15.139:0/818588400 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7fa8b404c350 con 0x7fa8cc076f00 2024-09-13T05:44:18.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:18.201+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/818588400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa8ac0053a0 con 0x7fa8cc076f00 2024-09-13T05:44:18.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:18.205+0000 7fa8c37fe640 1 -- 172.21.15.139:0/818588400 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fa8b403f210 con 0x7fa8cc076f00 2024-09-13T05:44:18.206 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-13T05:44:18.206 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T05:44:18.206 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"bf551932-7192-11ef-bceb-c7b262605968","modified":"2024-09-13T05:42:06.711537Z","created":"2024-09-13T05:42:06.711537Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T05:44:18.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:18.205+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/818588400 >> v2:172.21.15.79:6800/614049769 conn(0x7fa8b803f700 msgr2=0x7fa8b8041bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:18.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:18.205+0000 7fa8d0dcb640 1 --2- 172.21.15.139:0/818588400 >> v2:172.21.15.79:6800/614049769 conn(0x7fa8b803f700 0x7fa8b8041bc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0098c0 tx=0x7fa8bc006db0 comp rx=0 tx=0).stop 2024-09-13T05:44:18.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:18.205+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/818588400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc076f00 msgr2=0x7fa8cc19dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:18.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:18.205+0000 7fa8d0dcb640 1 --2- 172.21.15.139:0/818588400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc076f00 0x7fa8cc19dcb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40099a0 tx=0x7fa8b40048f0 comp rx=0 tx=0).stop 2024-09-13T05:44:18.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:18.205+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/818588400 shutdown_connections 2024-09-13T05:44:18.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:18.205+0000 7fa8d0dcb640 1 --2- 172.21.15.139:0/818588400 >> v2:172.21.15.79:6800/614049769 conn(0x7fa8b803f700 0x7fa8b8041bc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:18.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:18.205+0000 7fa8d0dcb640 1 --2- 172.21.15.139:0/818588400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc076f00 0x7fa8cc19dcb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:18.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:18.205+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/818588400 >> 172.21.15.139:0/818588400 conn(0x7fa8cc078270 msgr2=0x7fa8cc1050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:18.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:18.205+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/818588400 shutdown_connections 2024-09-13T05:44:18.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:18.205+0000 7fa8d0dcb640 1 -- 172.21.15.139:0/818588400 wait complete. 2024-09-13T05:44:19.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:18 smithi079 bash[22814]: cluster 2024-09-13T05:44:16.913096+0000 mgr.y (mgr.14152) 48 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:19.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:18 smithi079 bash[22814]: cluster 2024-09-13T05:44:16.913096+0000 mgr.y (mgr.14152) 48 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:19.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:18 smithi079 bash[22814]: audit 2024-09-13T05:44:18.206294+0000 mon.a (mon.0) 142 : audit [DBG] from='client.? 172.21.15.139:0/818588400' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:19.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:18 smithi079 bash[22814]: audit 2024-09-13T05:44:18.206294+0000 mon.a (mon.0) 142 : audit [DBG] from='client.? 172.21.15.139:0/818588400' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:19.955 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T05:44:19.956 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T05:44:20.282 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:20 smithi139 systemd[1]: Started Ceph mon.b for bf551932-7192-11ef-bceb-c7b262605968. 2024-09-13T05:44:20.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:20 smithi079 bash[22814]: cluster 2024-09-13T05:44:18.913553+0000 mgr.y (mgr.14152) 49 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:20.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:20 smithi079 bash[22814]: cluster 2024-09-13T05:44:18.913553+0000 mgr.y (mgr.14152) 49 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:20.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:20 smithi079 bash[22814]: audit 2024-09-13T05:44:20.206724+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:20.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:20 smithi079 bash[22814]: audit 2024-09-13T05:44:20.206724+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:20.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:20 smithi079 bash[22814]: audit 2024-09-13T05:44:20.212654+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:20.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:20 smithi079 bash[22814]: audit 2024-09-13T05:44:20.212654+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:20.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:20 smithi079 bash[22814]: audit 2024-09-13T05:44:20.219287+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:20.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:20 smithi079 bash[22814]: audit 2024-09-13T05:44:20.219287+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:20.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:20 smithi079 bash[22814]: audit 2024-09-13T05:44:20.220614+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:20.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:20 smithi079 bash[22814]: audit 2024-09-13T05:44:20.220614+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:20.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:20 smithi079 bash[22814]: audit 2024-09-13T05:44:20.222380+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:20.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:20 smithi079 bash[22814]: audit 2024-09-13T05:44:20.222380+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:21.186 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T05:44:21.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.189+0000 7fee7bfcfc80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-13T05:44:21.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.189+0000 7fee7bfcfc80 0 ceph version 19.3.0-4911-g9d608eb1 (9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3) squid (dev), process ceph-mon, pid 7 2024-09-13T05:44:21.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.189+0000 7fee7bfcfc80 0 pidfile_write: ignore empty --pid-file 2024-09-13T05:44:21.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.193+0000 7fee7bfcfc80 0 load: jerasure load: lrc 2024-09-13T05:44:21.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: RocksDB version: 7.9.2 2024-09-13T05:44:21.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Git sha 0 2024-09-13T05:44:21.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Compile date 2024-09-12 17:11:01 2024-09-13T05:44:21.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: DB SUMMARY 2024-09-13T05:44:21.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: DB Session ID: RPSOQTMN2WHNBNVR7G7U 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: CURRENT file: CURRENT 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 511 ; 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.error_if_exists: 0 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.create_if_missing: 0 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.paranoid_checks: 1 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.env: 0x561b50e93120 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.info_log: 0x561b51741700 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-13T05:44:21.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.statistics: (nil) 2024-09-13T05:44:21.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.use_fsync: 0 2024-09-13T05:44:21.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_log_file_size: 0 2024-09-13T05:44:21.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T05:44:21.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T05:44:21.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-13T05:44:21.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-13T05:44:21.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.allow_fallocate: 1 2024-09-13T05:44:21.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-13T05:44:21.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-13T05:44:21.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.use_direct_reads: 0 2024-09-13T05:44:21.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T05:44:21.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-13T05:44:21.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.db_log_dir: 2024-09-13T05:44:21.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.wal_dir: 2024-09-13T05:44:21.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T05:44:21.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T05:44:21.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T05:44:21.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T05:44:21.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T05:44:21.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.write_buffer_manager: 0x561b51745b80 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.unordered_write: 0 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T05:44:21.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.row_cache: None 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.wal_filter: None 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.two_write_queues: 0 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.wal_compression: 0 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.atomic_flush: 0 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.log_readahead_size: 0 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T05:44:21.627 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-13T05:44:21.628 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T05:44:21.628 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T05:44:21.628 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-13T05:44:21.628 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-13T05:44:21.628 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T05:44:21.628 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_background_jobs: 2 2024-09-13T05:44:21.628 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_background_compactions: -1 2024-09-13T05:44:21.628 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_subcompactions: 1 2024-09-13T05:44:21.628 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T05:44:21.628 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T05:44:21.628 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T05:44:21.628 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-13T05:44:21.628 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T05:44:21.628 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T05:44:21.629 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T05:44:21.629 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T05:44:21.629 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_open_files: -1 2024-09-13T05:44:21.629 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-13T05:44:21.629 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T05:44:21.629 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T05:44:21.629 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-13T05:44:21.629 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_background_flushes: -1 2024-09-13T05:44:21.629 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Compression algorithms supported: 2024-09-13T05:44:21.629 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: kZSTD supported: 0 2024-09-13T05:44:21.629 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: kXpressCompression supported: 0 2024-09-13T05:44:21.629 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: kBZip2Compression supported: 0 2024-09-13T05:44:21.629 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T05:44:21.629 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: kLZ4Compression supported: 1 2024-09-13T05:44:21.630 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: kZlibCompression supported: 1 2024-09-13T05:44:21.630 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-13T05:44:21.630 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: kSnappyCompression supported: 1 2024-09-13T05:44:21.630 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T05:44:21.630 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T05:44:21.630 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-13T05:44:21.630 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T05:44:21.631 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T05:44:21.631 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.merge_operator: 2024-09-13T05:44:21.631 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compaction_filter: None 2024-09-13T05:44:21.631 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-13T05:44:21.631 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-13T05:44:21.631 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T05:44:21.631 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T05:44:21.631 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561b51741320) 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cache_index_and_filter_blocks: 1 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: pin_top_level_index_and_filter: 1 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: index_type: 0 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: data_block_index_type: 0 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: index_shortening: 1 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: data_block_hash_table_util_ratio: 0.750000 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: checksum: 4 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: no_block_cache: 0 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: block_cache: 0x561b51737610 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: block_cache_name: BinnedLRUCache 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: block_cache_options: 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: capacity : 536870912 2024-09-13T05:44:21.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: num_shard_bits : 4 2024-09-13T05:44:21.633 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: strict_capacity_limit : 0 2024-09-13T05:44:21.633 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: high_pri_pool_ratio: 0.000 2024-09-13T05:44:21.633 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: block_cache_compressed: (nil) 2024-09-13T05:44:21.633 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: persistent_cache: (nil) 2024-09-13T05:44:21.633 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: block_size: 4096 2024-09-13T05:44:21.633 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: block_size_deviation: 10 2024-09-13T05:44:21.633 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: block_restart_interval: 16 2024-09-13T05:44:21.633 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: index_block_restart_interval: 1 2024-09-13T05:44:21.633 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: metadata_block_size: 4096 2024-09-13T05:44:21.633 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: partition_filters: 0 2024-09-13T05:44:21.633 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: use_delta_encoding: 1 2024-09-13T05:44:21.633 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: filter_policy: bloomfilter 2024-09-13T05:44:21.634 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: whole_key_filtering: 1 2024-09-13T05:44:21.634 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: verify_compression: 0 2024-09-13T05:44:21.634 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: read_amp_bytes_per_bit: 0 2024-09-13T05:44:21.634 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: format_version: 5 2024-09-13T05:44:21.634 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: enable_index_compression: 1 2024-09-13T05:44:21.634 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: block_align: 0 2024-09-13T05:44:21.634 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: max_auto_readahead_size: 262144 2024-09-13T05:44:21.634 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: prepopulate_block_cache: 0 2024-09-13T05:44:21.634 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: initial_auto_readahead_size: 8192 2024-09-13T05:44:21.634 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: num_file_reads_for_auto_readahead: 2 2024-09-13T05:44:21.635 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-13T05:44:21.635 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-13T05:44:21.635 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compression: NoCompression 2024-09-13T05:44:21.635 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-13T05:44:21.635 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-13T05:44:21.635 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T05:44:21.635 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.num_levels: 7 2024-09-13T05:44:21.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T05:44:21.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T05:44:21.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T05:44:21.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T05:44:21.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T05:44:21.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T05:44:21.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T05:44:21.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T05:44:21.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T05:44:21.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T05:44:21.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T05:44:21.636 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T05:44:21.637 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T05:44:21.637 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-13T05:44:21.637 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-13T05:44:21.637 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T05:44:21.637 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T05:44:21.637 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T05:44:21.637 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T05:44:21.637 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T05:44:21.638 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T05:44:21.639 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T05:44:21.640 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T05:44:21.640 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T05:44:21.640 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T05:44:21.640 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.inplace_update_support: 0 2024-09-13T05:44:21.640 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T05:44:21.640 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T05:44:21.640 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T05:44:21.640 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T05:44:21.640 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.bloom_locality: 0 2024-09-13T05:44:21.640 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.max_successive_merges: 0 2024-09-13T05:44:21.640 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T05:44:21.640 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-13T05:44:21.640 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-13T05:44:21.641 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-13T05:44:21.641 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.ttl: 2592000 2024-09-13T05:44:21.641 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T05:44:21.641 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T05:44:21.641 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T05:44:21.641 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.enable_blob_files: false 2024-09-13T05:44:21.641 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.min_blob_size: 0 2024-09-13T05:44:21.641 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-13T05:44:21.641 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T05:44:21.641 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T05:44:21.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T05:44:21.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T05:44:21.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T05:44:21.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-13T05:44:21.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T05:44:21.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T05:44:21.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-13T05:44:21.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fabbce93-436a-4b16-ac48-8603c27d69b7 2024-09-13T05:44:21.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726206261199655, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-13T05:44:21.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-13T05:44:21.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726206261201672, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726206261, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fabbce93-436a-4b16-ac48-8603c27d69b7", "db_session_id": "RPSOQTMN2WHNBNVR7G7U", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-13T05:44:21.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726206261201811, "job": 1, "event": "recovery_finished"} 2024-09-13T05:44:21.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.197+0000 7fee7bfcfc80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-13T05:44:21.642 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.201+0000 7fee7bfcfc80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T05:44:21.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.201+0000 7fee7bfcfc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561b51764e00 2024-09-13T05:44:21.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.201+0000 7fee7bfcfc80 4 rocksdb: DB pointer 0x561b51868000 2024-09-13T05:44:21.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.201+0000 7fee71d97640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T05:44:21.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.201+0000 7fee71d97640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T05:44:21.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: ** DB Stats ** 2024-09-13T05:44:21.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T05:44:21.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T05:44:21.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T05:44:21.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T05:44:21.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T05:44:21.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T05:44:21.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: ** Compaction Stats [default] ** 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: ** Compaction Stats [default] ** 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T05:44:21.644 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T05:44:21.645 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T05:44:21.645 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: AddFile(Keys): cumulative 0, interval 0 2024-09-13T05:44:21.645 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Cumulative compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T05:44:21.645 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Interval compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T05:44:21.645 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T05:44:21.645 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Block cache BinnedLRUCache@0x561b51737610#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-13T05:44:21.645 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-13T05:44:21.645 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: ** File Read Latency Histogram By Level [default] ** 2024-09-13T05:44:21.645 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.201+0000 7fee7bfcfc80 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-13T05:44:21.645 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.201+0000 7fee7bfcfc80 0 using public_addr v2:172.21.15.139:0/0 -> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] 2024-09-13T05:44:21.645 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.201+0000 7fee7bfcfc80 0 starting mon.b rank -1 at public addrs [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] at bind addrs [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:21.645 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.205+0000 7fee7bfcfc80 1 mon.b@-1(???) e0 preinit fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:21.645 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.229+0000 7fee74d9d640 0 mon.b@-1(synchronizing).mds e1 new map 2024-09-13T05:44:21.646 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.229+0000 7fee74d9d640 0 mon.b@-1(synchronizing).mds e1 print_map 2024-09-13T05:44:21.646 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: e1 2024-09-13T05:44:21.646 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: btime 2024-09-13T05:42:11:461872+0000 2024-09-13T05:44:21.646 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T05:44:21.646 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T05:44:21.646 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: legacy client fscid: -1 2024-09-13T05:44:21.646 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: 2024-09-13T05:44:21.646 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: No filesystems configured 2024-09-13T05:44:21.646 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.229+0000 7fee74d9d640 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-13T05:44:21.646 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.229+0000 7fee74d9d640 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-13T05:44:21.646 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.229+0000 7fee74d9d640 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-13T05:44:21.646 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.229+0000 7fee74d9d640 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-13T05:44:21.646 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.229+0000 7fee74d9d640 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-13T05:44:21.646 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.229+0000 7fee74d9d640 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-13T05:44:21.647 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.229+0000 7fee74d9d640 0 mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T05:44:21.647 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.229+0000 7fee74d9d640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T05:44:21.648 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.229+0000 7fee74d9d640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T05:44:21.648 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.229+0000 7fee74d9d640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T05:44:21.648 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:39.907033+0000 mon.a (mon.0) 107 : audit [INF] from='client.? 172.21.15.79:0/1831551373' entity='client.admin' 2024-09-13T05:44:21.648 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:39.907033+0000 mon.a (mon.0) 107 : audit [INF] from='client.? 172.21.15.79:0/1831551373' entity='client.admin' 2024-09-13T05:44:21.648 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:39.922964+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:21.648 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:39.922964+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:21.648 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:39.927971+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.648 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:39.927971+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.648 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:40.905825+0000 mgr.y (mgr.14152) 14 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.648 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:40.905825+0000 mgr.y (mgr.14152) 14 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.648 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:42.906346+0000 mgr.y (mgr.14152) 15 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.648 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:42.906346+0000 mgr.y (mgr.14152) 15 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.648 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:44.906733+0000 mgr.y (mgr.14152) 16 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:44.906733+0000 mgr.y (mgr.14152) 16 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:46.782292+0000 mgr.y (mgr.14152) 17 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:21.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:46.782292+0000 mgr.y (mgr.14152) 17 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:21.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:46.785151+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:46.785151+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:46.786340+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:21.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:46.786340+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:21.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:46.788722+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:21.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:46.788722+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:21.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:46.789766+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:21.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:46.789766+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:21.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:43:46.791478+0000 mgr.y (mgr.14152) 18 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.conf 2024-09-13T05:44:21.649 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:43:46.791478+0000 mgr.y (mgr.14152) 18 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.conf 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:43:46.866094+0000 mgr.y (mgr.14152) 19 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:43:46.866094+0000 mgr.y (mgr.14152) 19 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:46.906977+0000 mgr.y (mgr.14152) 20 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:46.906977+0000 mgr.y (mgr.14152) 20 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:47.033192+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:47.033192+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:47.038146+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:47.038146+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:47.043652+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:47.043652+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:43:46.919451+0000 mgr.y (mgr.14152) 21 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:43:46.919451+0000 mgr.y (mgr.14152) 21 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:43:46.970867+0000 mgr.y (mgr.14152) 22 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:43:46.970867+0000 mgr.y (mgr.14152) 22 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:48.907395+0000 mgr.y (mgr.14152) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:48.907395+0000 mgr.y (mgr.14152) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.651 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:50.907849+0000 mgr.y (mgr.14152) 24 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.651 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:50.907849+0000 mgr.y (mgr.14152) 24 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.651 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:52.908330+0000 mgr.y (mgr.14152) 25 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.651 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:52.908330+0000 mgr.y (mgr.14152) 25 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.651 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:53.629634+0000 mgr.y (mgr.14152) 26 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:21.651 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:53.629634+0000 mgr.y (mgr.14152) 26 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:21.651 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:43:54.632781+0000 mgr.y (mgr.14152) 27 : cephadm [INF] Deploying cephadm binary to smithi139 2024-09-13T05:44:21.651 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:43:54.632781+0000 mgr.y (mgr.14152) 27 : cephadm [INF] Deploying cephadm binary to smithi139 2024-09-13T05:44:21.651 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:54.908721+0000 mgr.y (mgr.14152) 28 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.651 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:54.908721+0000 mgr.y (mgr.14152) 28 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.651 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:56.908965+0000 mgr.y (mgr.14152) 29 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.651 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:56.908965+0000 mgr.y (mgr.14152) 29 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.651 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:57.878163+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.652 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:57.878163+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.652 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:43:57.879027+0000 mgr.y (mgr.14152) 30 : cephadm [INF] Added host smithi139 2024-09-13T05:44:21.652 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:43:57.879027+0000 mgr.y (mgr.14152) 30 : cephadm [INF] Added host smithi139 2024-09-13T05:44:21.652 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:57.879932+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:21.652 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:57.879932+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:21.652 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:58.373490+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.653 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:58.373490+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.653 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:58.909295+0000 mgr.y (mgr.14152) 31 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.653 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:43:58.909295+0000 mgr.y (mgr.14152) 31 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.653 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:59.914938+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.653 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:43:59.914938+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.653 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:00.909719+0000 mgr.y (mgr.14152) 32 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.653 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:00.909719+0000 mgr.y (mgr.14152) 32 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.654 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:01.074314+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.654 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:01.074314+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.654 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:02.910097+0000 mgr.y (mgr.14152) 33 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.654 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:02.910097+0000 mgr.y (mgr.14152) 33 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.654 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:04.611656+0000 mgr.y (mgr.14152) 34 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T05:44:21.654 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:04.611656+0000 mgr.y (mgr.14152) 34 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T05:44:21.655 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:04.910470+0000 mgr.y (mgr.14152) 35 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.655 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:04.910470+0000 mgr.y (mgr.14152) 35 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.655 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.399856+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.655 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.399856+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.655 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.407612+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.655 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.407612+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.655 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.416098+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.655 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.416098+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.655 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.423480+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.656 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.423480+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.656 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.425148+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"} : dispatch 2024-09-13T05:44:21.656 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.425148+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"} : dispatch 2024-09-13T05:44:21.656 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.427153+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:21.656 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.427153+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:21.656 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.428949+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:21.656 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.428949+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:21.657 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:44:06.431444+0000 mgr.y (mgr.14152) 36 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T05:44:21.657 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:44:06.431444+0000 mgr.y (mgr.14152) 36 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T05:44:21.657 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:44:06.543603+0000 mgr.y (mgr.14152) 37 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:21.657 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:44:06.543603+0000 mgr.y (mgr.14152) 37 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:21.657 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:44:06.640665+0000 mgr.y (mgr.14152) 38 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:44:21.657 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:44:06.640665+0000 mgr.y (mgr.14152) 38 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:44:21.657 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:44:06.729852+0000 mgr.y (mgr.14152) 39 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T05:44:21.657 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:44:06.729852+0000 mgr.y (mgr.14152) 39 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T05:44:21.657 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.824033+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.658 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.824033+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.658 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.831932+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.658 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.831932+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.658 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.840249+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.658 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:06.840249+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.659 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:06.910925+0000 mgr.y (mgr.14152) 40 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.659 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:06.910925+0000 mgr.y (mgr.14152) 40 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.659 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:08.911296+0000 mgr.y (mgr.14152) 41 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.659 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:08.911296+0000 mgr.y (mgr.14152) 41 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.659 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:11.397337+0000 mon.a (mon.0) 132 : audit [INF] from='client.? 172.21.15.79:0/3645385921' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-13T05:44:21.659 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:11.397337+0000 mon.a (mon.0) 132 : audit [INF] from='client.? 172.21.15.79:0/3645385921' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-13T05:44:21.659 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:10.911705+0000 mgr.y (mgr.14152) 42 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.660 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:10.911705+0000 mgr.y (mgr.14152) 42 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.660 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:11.409502+0000 mon.a (mon.0) 133 : audit [INF] from='client.? 172.21.15.79:0/3645385921' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T05:44:21.660 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:11.409502+0000 mon.a (mon.0) 133 : audit [INF] from='client.? 172.21.15.79:0/3645385921' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T05:44:21.660 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:11.414062+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:21.660 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:11.414062+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:21.660 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:12.912144+0000 mgr.y (mgr.14152) 43 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.660 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:12.912144+0000 mgr.y (mgr.14152) 43 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.660 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.718851+0000 mgr.y (mgr.14152) 44 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi079:172.21.15.79=a;smithi079:[v2:172.21.15.79:3301,v1:172.21.15.79:6790]=c;smithi139:172.21.15.139=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:21.660 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.718851+0000 mgr.y (mgr.14152) 44 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi079:172.21.15.79=a;smithi079:[v2:172.21.15.79:3301,v1:172.21.15.79:6790]=c;smithi139:172.21.15.139=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:21.660 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:44:14.724160+0000 mgr.y (mgr.14152) 45 : cephadm [INF] Saving service mon spec with placement smithi079:172.21.15.79=a;smithi079:[v2:172.21.15.79:3301,v1:172.21.15.79:6790]=c;smithi139:172.21.15.139=b;count:3 2024-09-13T05:44:21.660 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:44:14.724160+0000 mgr.y (mgr.14152) 45 : cephadm [INF] Saving service mon spec with placement smithi079:172.21.15.79=a;smithi079:[v2:172.21.15.79:3301,v1:172.21.15.79:6790]=c;smithi139:172.21.15.139=b;count:3 2024-09-13T05:44:21.660 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.729858+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.660 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.729858+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.660 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.731490+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:21.661 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.731490+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:21.661 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.734749+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:21.661 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.734749+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:21.661 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.736384+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:21.661 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.736384+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:21.661 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.744795+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.661 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.744795+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.661 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.748581+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:21.661 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.748581+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:21.662 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.750292+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:21.662 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:14.750292+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:21.662 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:44:14.752148+0000 mgr.y (mgr.14152) 46 : cephadm [INF] Deploying daemon mon.b on smithi139 2024-09-13T05:44:21.662 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cephadm 2024-09-13T05:44:14.752148+0000 mgr.y (mgr.14152) 46 : cephadm [INF] Deploying daemon mon.b on smithi139 2024-09-13T05:44:21.662 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:14.912637+0000 mgr.y (mgr.14152) 47 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.662 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:14.912637+0000 mgr.y (mgr.14152) 47 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.662 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:16.913096+0000 mgr.y (mgr.14152) 48 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.662 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:16.913096+0000 mgr.y (mgr.14152) 48 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.662 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:18.206294+0000 mon.a (mon.0) 142 : audit [DBG] from='client.? 172.21.15.139:0/818588400' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:21.662 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:18.206294+0000 mon.a (mon.0) 142 : audit [DBG] from='client.? 172.21.15.139:0/818588400' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:21.662 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:18.913553+0000 mgr.y (mgr.14152) 49 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.662 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: cluster 2024-09-13T05:44:18.913553+0000 mgr.y (mgr.14152) 49 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:21.662 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:20.206724+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.663 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:20.206724+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.663 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:20.212654+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.663 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:20.212654+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.663 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:20.219287+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.663 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:20.219287+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:21.663 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:20.220614+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:21.663 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:20.220614+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:21.663 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:20.222380+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:21.663 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: audit 2024-09-13T05:44:20.222380+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:21.663 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:21 smithi139 bash[24829]: debug 2024-09-13T05:44:21.233+0000 7fee74d9d640 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-13T05:44:24.385 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:24 smithi079 systemd[1]: /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T05:44:24.386 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:44:24 smithi079 systemd[1]: /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T05:44:24.732 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:44:24 smithi079 systemd[1]: /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T05:44:24.732 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:24 smithi079 systemd[1]: Started Ceph mon.c for bf551932-7192-11ef-bceb-c7b262605968. 2024-09-13T05:44:24.733 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:24 smithi079 systemd[1]: /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T05:44:25.989 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.681+0000 7fbc77b30c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-13T05:44:25.989 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.681+0000 7fbc77b30c80 0 ceph version 19.3.0-4911-g9d608eb1 (9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3) squid (dev), process ceph-mon, pid 7 2024-09-13T05:44:25.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.681+0000 7fbc77b30c80 0 pidfile_write: ignore empty --pid-file 2024-09-13T05:44:25.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 0 load: jerasure load: lrc 2024-09-13T05:44:25.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: RocksDB version: 7.9.2 2024-09-13T05:44:25.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Git sha 0 2024-09-13T05:44:25.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Compile date 2024-09-12 17:11:01 2024-09-13T05:44:25.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: DB SUMMARY 2024-09-13T05:44:25.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: DB Session ID: X9WFRQB9U1WM9X5Q3B6V 2024-09-13T05:44:25.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: CURRENT file: CURRENT 2024-09-13T05:44:25.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-13T05:44:25.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-13T05:44:25.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-13T05:44:25.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-13T05:44:25.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.error_if_exists: 0 2024-09-13T05:44:25.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.create_if_missing: 0 2024-09-13T05:44:25.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.paranoid_checks: 1 2024-09-13T05:44:25.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T05:44:25.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T05:44:25.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T05:44:25.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.env: 0x5641119b6120 2024-09-13T05:44:25.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-13T05:44:25.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.info_log: 0x56411236b700 2024-09-13T05:44:25.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-13T05:44:25.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.statistics: (nil) 2024-09-13T05:44:25.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.use_fsync: 0 2024-09-13T05:44:25.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_log_file_size: 0 2024-09-13T05:44:25.992 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T05:44:25.992 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T05:44:25.992 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-13T05:44:25.992 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-13T05:44:25.993 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.allow_fallocate: 1 2024-09-13T05:44:25.993 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-13T05:44:25.993 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-13T05:44:25.993 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.use_direct_reads: 0 2024-09-13T05:44:25.993 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T05:44:25.993 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-13T05:44:25.993 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.db_log_dir: 2024-09-13T05:44:25.993 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.wal_dir: 2024-09-13T05:44:25.993 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T05:44:25.993 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T05:44:25.993 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T05:44:25.993 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T05:44:25.994 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T05:44:25.994 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T05:44:25.994 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-13T05:44:25.994 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-13T05:44:25.994 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.write_buffer_manager: 0x56411236fb80 2024-09-13T05:44:25.994 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T05:44:25.994 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T05:44:25.994 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T05:44:25.994 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-13T05:44:25.994 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T05:44:25.994 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-13T05:44:25.994 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-13T05:44:25.994 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-13T05:44:25.995 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.unordered_write: 0 2024-09-13T05:44:25.995 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T05:44:25.995 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T05:44:25.995 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T05:44:25.995 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T05:44:25.995 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.row_cache: None 2024-09-13T05:44:25.995 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.wal_filter: None 2024-09-13T05:44:25.995 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T05:44:25.995 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-13T05:44:25.995 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.two_write_queues: 0 2024-09-13T05:44:25.995 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-13T05:44:25.995 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.wal_compression: 0 2024-09-13T05:44:25.995 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.atomic_flush: 0 2024-09-13T05:44:25.996 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T05:44:25.996 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T05:44:25.996 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T05:44:25.996 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.log_readahead_size: 0 2024-09-13T05:44:25.996 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T05:44:25.996 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-13T05:44:25.996 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T05:44:25.996 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T05:44:25.996 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-13T05:44:25.996 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-13T05:44:25.996 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T05:44:25.996 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_background_jobs: 2 2024-09-13T05:44:25.996 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_background_compactions: -1 2024-09-13T05:44:25.997 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_subcompactions: 1 2024-09-13T05:44:25.997 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T05:44:25.997 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T05:44:25.997 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T05:44:25.997 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-13T05:44:25.997 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T05:44:25.997 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T05:44:25.997 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T05:44:25.997 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T05:44:25.997 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_open_files: -1 2024-09-13T05:44:25.997 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-13T05:44:25.997 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T05:44:25.997 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T05:44:25.998 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-13T05:44:25.998 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_background_flushes: -1 2024-09-13T05:44:25.998 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Compression algorithms supported: 2024-09-13T05:44:25.998 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: kZSTD supported: 0 2024-09-13T05:44:25.998 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: kXpressCompression supported: 0 2024-09-13T05:44:25.998 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: kBZip2Compression supported: 0 2024-09-13T05:44:25.998 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T05:44:25.998 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: kLZ4Compression supported: 1 2024-09-13T05:44:25.998 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: kZlibCompression supported: 1 2024-09-13T05:44:25.998 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-13T05:44:25.998 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: kSnappyCompression supported: 1 2024-09-13T05:44:25.998 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T05:44:25.998 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T05:44:25.999 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-13T05:44:25.999 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T05:44:26.001 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T05:44:26.001 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.merge_operator: 2024-09-13T05:44:26.001 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compaction_filter: None 2024-09-13T05:44:26.001 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-13T05:44:26.001 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-13T05:44:26.001 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T05:44:26.001 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T05:44:26.001 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56411236b320) 2024-09-13T05:44:26.001 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cache_index_and_filter_blocks: 1 2024-09-13T05:44:26.001 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T05:44:26.002 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T05:44:26.002 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: pin_top_level_index_and_filter: 1 2024-09-13T05:44:26.002 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: index_type: 0 2024-09-13T05:44:26.002 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: data_block_index_type: 0 2024-09-13T05:44:26.002 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: index_shortening: 1 2024-09-13T05:44:26.002 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: data_block_hash_table_util_ratio: 0.750000 2024-09-13T05:44:26.002 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: checksum: 4 2024-09-13T05:44:26.002 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: no_block_cache: 0 2024-09-13T05:44:26.002 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: block_cache: 0x564112361610 2024-09-13T05:44:26.002 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: block_cache_name: BinnedLRUCache 2024-09-13T05:44:26.002 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: block_cache_options: 2024-09-13T05:44:26.002 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: capacity : 536870912 2024-09-13T05:44:26.002 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: num_shard_bits : 4 2024-09-13T05:44:26.002 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: strict_capacity_limit : 0 2024-09-13T05:44:26.003 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: high_pri_pool_ratio: 0.000 2024-09-13T05:44:26.003 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: block_cache_compressed: (nil) 2024-09-13T05:44:26.003 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: persistent_cache: (nil) 2024-09-13T05:44:26.003 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: block_size: 4096 2024-09-13T05:44:26.003 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: block_size_deviation: 10 2024-09-13T05:44:26.003 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: block_restart_interval: 16 2024-09-13T05:44:26.003 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: index_block_restart_interval: 1 2024-09-13T05:44:26.003 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: metadata_block_size: 4096 2024-09-13T05:44:26.003 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: partition_filters: 0 2024-09-13T05:44:26.003 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: use_delta_encoding: 1 2024-09-13T05:44:26.003 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: filter_policy: bloomfilter 2024-09-13T05:44:26.003 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: whole_key_filtering: 1 2024-09-13T05:44:26.003 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: verify_compression: 0 2024-09-13T05:44:26.004 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: read_amp_bytes_per_bit: 0 2024-09-13T05:44:26.004 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: format_version: 5 2024-09-13T05:44:26.004 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: enable_index_compression: 1 2024-09-13T05:44:26.004 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: block_align: 0 2024-09-13T05:44:26.004 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: max_auto_readahead_size: 262144 2024-09-13T05:44:26.004 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: prepopulate_block_cache: 0 2024-09-13T05:44:26.004 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: initial_auto_readahead_size: 8192 2024-09-13T05:44:26.004 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: num_file_reads_for_auto_readahead: 2 2024-09-13T05:44:26.004 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-13T05:44:26.004 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-13T05:44:26.004 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compression: NoCompression 2024-09-13T05:44:26.004 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-13T05:44:26.004 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-13T05:44:26.004 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T05:44:26.005 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.num_levels: 7 2024-09-13T05:44:26.005 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T05:44:26.005 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T05:44:26.005 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T05:44:26.005 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T05:44:26.005 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T05:44:26.005 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T05:44:26.005 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T05:44:26.005 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T05:44:26.005 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T05:44:26.005 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T05:44:26.005 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T05:44:26.005 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T05:44:26.005 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T05:44:26.006 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-13T05:44:26.006 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-13T05:44:26.006 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T05:44:26.006 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T05:44:26.006 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T05:44:26.006 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T05:44:26.006 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-13T05:44:26.006 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T05:44:26.006 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T05:44:26.006 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T05:44:26.006 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T05:44:26.006 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-13T05:44:26.006 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T05:44:26.007 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T05:44:26.007 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T05:44:26.007 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T05:44:26.007 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T05:44:26.007 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T05:44:26.007 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T05:44:26.007 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T05:44:26.007 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T05:44:26.007 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T05:44:26.007 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T05:44:26.007 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T05:44:26.007 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T05:44:26.007 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T05:44:26.007 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-13T05:44:26.008 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T05:44:26.008 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T05:44:26.008 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-13T05:44:26.008 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T05:44:26.008 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T05:44:26.008 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T05:44:26.008 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T05:44:26.008 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T05:44:26.008 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T05:44:26.008 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T05:44:26.008 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T05:44:26.008 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T05:44:26.008 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T05:44:26.008 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.bloom_locality: 0 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.ttl: 2592000 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T05:44:26.009 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T05:44:26.010 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.enable_blob_files: false 2024-09-13T05:44:26.010 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.min_blob_size: 0 2024-09-13T05:44:26.010 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-13T05:44:26.010 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T05:44:26.010 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T05:44:26.010 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T05:44:26.010 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T05:44:26.010 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T05:44:26.010 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-13T05:44:26.010 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T05:44:26.010 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T05:44:26.010 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-13T05:44:26.010 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ed5ffb0c-024f-47c2-b9a8-9c6407e76c1b 2024-09-13T05:44:26.010 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726206265690726, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-13T05:44:26.011 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.685+0000 7fbc77b30c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-13T05:44:26.011 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.689+0000 7fbc77b30c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726206265691209, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726206265, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ed5ffb0c-024f-47c2-b9a8-9c6407e76c1b", "db_session_id": "X9WFRQB9U1WM9X5Q3B6V", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-13T05:44:26.011 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.689+0000 7fbc77b30c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726206265691338, "job": 1, "event": "recovery_finished"} 2024-09-13T05:44:26.011 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.689+0000 7fbc77b30c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-13T05:44:26.011 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.689+0000 7fbc77b30c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T05:44:26.011 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.689+0000 7fbc77b30c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56411238ee00 2024-09-13T05:44:26.011 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.689+0000 7fbc77b30c80 4 rocksdb: DB pointer 0x564112492000 2024-09-13T05:44:26.011 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.689+0000 7fbc6d8f8640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T05:44:26.011 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.689+0000 7fbc6d8f8640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T05:44:26.011 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: ** DB Stats ** 2024-09-13T05:44:26.011 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T05:44:26.011 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T05:44:26.011 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T05:44:26.011 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T05:44:26.012 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T05:44:26.012 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T05:44:26.012 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T05:44:26.012 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: ** Compaction Stats [default] ** 2024-09-13T05:44:26.012 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T05:44:26.012 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T05:44:26.012 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T05:44:26.012 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T05:44:26.012 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T05:44:26.012 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: ** Compaction Stats [default] ** 2024-09-13T05:44:26.012 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T05:44:26.012 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T05:44:26.012 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T05:44:26.013 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T05:44:26.013 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T05:44:26.013 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T05:44:26.013 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T05:44:26.013 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T05:44:26.013 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T05:44:26.013 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: AddFile(Keys): cumulative 0, interval 0 2024-09-13T05:44:26.013 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Cumulative compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T05:44:26.013 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Interval compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T05:44:26.013 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T05:44:26.013 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Block cache BinnedLRUCache@0x564112361610#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2024-09-13T05:44:26.013 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-13T05:44:26.013 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: ** File Read Latency Histogram By Level [default] ** 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.689+0000 7fbc77b30c80 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.689+0000 7fbc77b30c80 0 using public_addrv [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.689+0000 7fbc77b30c80 0 starting mon.c rank -1 at public addrs [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] at bind addrs [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.693+0000 7fbc77b30c80 1 mon.c@-1(???) e0 preinit fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.709+0000 7fbc708fe640 0 mon.c@-1(synchronizing).mds e1 new map 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.709+0000 7fbc708fe640 0 mon.c@-1(synchronizing).mds e1 print_map 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: e1 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: btime 2024-09-13T05:42:11:461872+0000 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: legacy client fscid: -1 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: No filesystems configured 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.713+0000 7fbc708fe640 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-13T05:44:26.014 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.713+0000 7fbc708fe640 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-13T05:44:26.015 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.713+0000 7fbc708fe640 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-13T05:44:26.015 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.713+0000 7fbc708fe640 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-13T05:44:26.015 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.713+0000 7fbc708fe640 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-13T05:44:26.015 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.713+0000 7fbc708fe640 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-13T05:44:26.015 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.713+0000 7fbc708fe640 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T05:44:26.015 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.713+0000 7fbc708fe640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T05:44:26.015 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.713+0000 7fbc708fe640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T05:44:26.015 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.713+0000 7fbc708fe640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T05:44:26.015 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:39.907033+0000 mon.a (mon.0) 107 : audit [INF] from='client.? 172.21.15.79:0/1831551373' entity='client.admin' 2024-09-13T05:44:26.015 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:39.907033+0000 mon.a (mon.0) 107 : audit [INF] from='client.? 172.21.15.79:0/1831551373' entity='client.admin' 2024-09-13T05:44:26.015 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:39.922964+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:26.015 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:39.922964+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:26.015 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:39.927971+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.016 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:39.927971+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.016 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:40.905825+0000 mgr.y (mgr.14152) 14 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.016 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:40.905825+0000 mgr.y (mgr.14152) 14 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.016 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:42.906346+0000 mgr.y (mgr.14152) 15 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.016 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:42.906346+0000 mgr.y (mgr.14152) 15 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.016 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:44.906733+0000 mgr.y (mgr.14152) 16 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.016 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:44.906733+0000 mgr.y (mgr.14152) 16 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.016 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:46.782292+0000 mgr.y (mgr.14152) 17 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:26.016 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:46.782292+0000 mgr.y (mgr.14152) 17 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:26.016 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:46.785151+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.016 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:46.785151+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.016 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:46.786340+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:26.016 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:46.786340+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:26.016 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:46.788722+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:46.788722+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:46.789766+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:46.789766+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:43:46.791478+0000 mgr.y (mgr.14152) 18 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.conf 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:43:46.791478+0000 mgr.y (mgr.14152) 18 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.conf 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:43:46.866094+0000 mgr.y (mgr.14152) 19 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:43:46.866094+0000 mgr.y (mgr.14152) 19 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:46.906977+0000 mgr.y (mgr.14152) 20 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:46.906977+0000 mgr.y (mgr.14152) 20 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:47.033192+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:47.033192+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:47.038146+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:47.038146+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:47.043652+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.017 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:47.043652+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:43:46.919451+0000 mgr.y (mgr.14152) 21 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:43:46.919451+0000 mgr.y (mgr.14152) 21 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:43:46.970867+0000 mgr.y (mgr.14152) 22 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:43:46.970867+0000 mgr.y (mgr.14152) 22 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:48.907395+0000 mgr.y (mgr.14152) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:48.907395+0000 mgr.y (mgr.14152) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:50.907849+0000 mgr.y (mgr.14152) 24 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:50.907849+0000 mgr.y (mgr.14152) 24 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:52.908330+0000 mgr.y (mgr.14152) 25 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:52.908330+0000 mgr.y (mgr.14152) 25 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:53.629634+0000 mgr.y (mgr.14152) 26 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:53.629634+0000 mgr.y (mgr.14152) 26 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:43:54.632781+0000 mgr.y (mgr.14152) 27 : cephadm [INF] Deploying cephadm binary to smithi139 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:43:54.632781+0000 mgr.y (mgr.14152) 27 : cephadm [INF] Deploying cephadm binary to smithi139 2024-09-13T05:44:26.018 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:54.908721+0000 mgr.y (mgr.14152) 28 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:54.908721+0000 mgr.y (mgr.14152) 28 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:56.908965+0000 mgr.y (mgr.14152) 29 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:56.908965+0000 mgr.y (mgr.14152) 29 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:57.878163+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:57.878163+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:43:57.879027+0000 mgr.y (mgr.14152) 30 : cephadm [INF] Added host smithi139 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:43:57.879027+0000 mgr.y (mgr.14152) 30 : cephadm [INF] Added host smithi139 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:57.879932+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:57.879932+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:58.373490+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:58.373490+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:58.909295+0000 mgr.y (mgr.14152) 31 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:43:58.909295+0000 mgr.y (mgr.14152) 31 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:59.914938+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.019 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:43:59.914938+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:00.909719+0000 mgr.y (mgr.14152) 32 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:00.909719+0000 mgr.y (mgr.14152) 32 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:01.074314+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:01.074314+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:02.910097+0000 mgr.y (mgr.14152) 33 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:02.910097+0000 mgr.y (mgr.14152) 33 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:04.611656+0000 mgr.y (mgr.14152) 34 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:04.611656+0000 mgr.y (mgr.14152) 34 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:04.910470+0000 mgr.y (mgr.14152) 35 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:04.910470+0000 mgr.y (mgr.14152) 35 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.399856+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.399856+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.407612+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.407612+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.020 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.416098+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.021 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.416098+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.021 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.423480+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.021 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.423480+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.021 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.425148+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"} : dispatch 2024-09-13T05:44:26.021 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.425148+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"} : dispatch 2024-09-13T05:44:26.021 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.427153+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:26.021 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.427153+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:26.021 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.428949+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:26.021 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.428949+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:26.021 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:44:06.431444+0000 mgr.y (mgr.14152) 36 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T05:44:26.021 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:44:06.431444+0000 mgr.y (mgr.14152) 36 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:44:06.543603+0000 mgr.y (mgr.14152) 37 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:44:06.543603+0000 mgr.y (mgr.14152) 37 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:44:06.640665+0000 mgr.y (mgr.14152) 38 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:44:06.640665+0000 mgr.y (mgr.14152) 38 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:44:06.729852+0000 mgr.y (mgr.14152) 39 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:44:06.729852+0000 mgr.y (mgr.14152) 39 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.824033+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.824033+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.831932+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.831932+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.840249+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:06.840249+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:06.910925+0000 mgr.y (mgr.14152) 40 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:06.910925+0000 mgr.y (mgr.14152) 40 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.022 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:08.911296+0000 mgr.y (mgr.14152) 41 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:08.911296+0000 mgr.y (mgr.14152) 41 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:11.397337+0000 mon.a (mon.0) 132 : audit [INF] from='client.? 172.21.15.79:0/3645385921' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:11.397337+0000 mon.a (mon.0) 132 : audit [INF] from='client.? 172.21.15.79:0/3645385921' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:10.911705+0000 mgr.y (mgr.14152) 42 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:10.911705+0000 mgr.y (mgr.14152) 42 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:11.409502+0000 mon.a (mon.0) 133 : audit [INF] from='client.? 172.21.15.79:0/3645385921' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:11.409502+0000 mon.a (mon.0) 133 : audit [INF] from='client.? 172.21.15.79:0/3645385921' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:11.414062+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:11.414062+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:12.912144+0000 mgr.y (mgr.14152) 43 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:12.912144+0000 mgr.y (mgr.14152) 43 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.718851+0000 mgr.y (mgr.14152) 44 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi079:172.21.15.79=a;smithi079:[v2:172.21.15.79:3301,v1:172.21.15.79:6790]=c;smithi139:172.21.15.139=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.718851+0000 mgr.y (mgr.14152) 44 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi079:172.21.15.79=a;smithi079:[v2:172.21.15.79:3301,v1:172.21.15.79:6790]=c;smithi139:172.21.15.139=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:44:14.724160+0000 mgr.y (mgr.14152) 45 : cephadm [INF] Saving service mon spec with placement smithi079:172.21.15.79=a;smithi079:[v2:172.21.15.79:3301,v1:172.21.15.79:6790]=c;smithi139:172.21.15.139=b;count:3 2024-09-13T05:44:26.023 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:44:14.724160+0000 mgr.y (mgr.14152) 45 : cephadm [INF] Saving service mon spec with placement smithi079:172.21.15.79=a;smithi079:[v2:172.21.15.79:3301,v1:172.21.15.79:6790]=c;smithi139:172.21.15.139=b;count:3 2024-09-13T05:44:26.024 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.729858+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.024 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.729858+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.024 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.731490+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:26.024 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.731490+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:26.024 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.734749+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:26.024 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.734749+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:26.024 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.736384+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.736384+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.744795+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.744795+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.748581+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.748581+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.750292+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:14.750292+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:44:14.752148+0000 mgr.y (mgr.14152) 46 : cephadm [INF] Deploying daemon mon.b on smithi139 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cephadm 2024-09-13T05:44:14.752148+0000 mgr.y (mgr.14152) 46 : cephadm [INF] Deploying daemon mon.b on smithi139 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:14.912637+0000 mgr.y (mgr.14152) 47 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:14.912637+0000 mgr.y (mgr.14152) 47 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:16.913096+0000 mgr.y (mgr.14152) 48 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:16.913096+0000 mgr.y (mgr.14152) 48 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:18.206294+0000 mon.a (mon.0) 142 : audit [DBG] from='client.? 172.21.15.139:0/818588400' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:26.025 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:18.206294+0000 mon.a (mon.0) 142 : audit [DBG] from='client.? 172.21.15.139:0/818588400' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:26.026 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:18.913553+0000 mgr.y (mgr.14152) 49 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.026 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: cluster 2024-09-13T05:44:18.913553+0000 mgr.y (mgr.14152) 49 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.026 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:20.206724+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.026 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:20.206724+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.026 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:20.212654+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.026 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:20.212654+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.026 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:20.219287+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.026 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:20.219287+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.026 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:20.220614+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:26.026 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:20.220614+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:26.026 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:20.222380+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:26.026 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: audit 2024-09-13T05:44:20.222380+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:26.026 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:25 smithi079 bash[31923]: debug 2024-09-13T05:44:25.717+0000 7fbc708fe640 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-13T05:44:26.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe23e5e2640 1 -- 172.21.15.139:0/283250145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe224003530 msgr2=0x7fe2240059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:26.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe23e5e2640 1 --2- 172.21.15.139:0/283250145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe224003530 0x7fe2240059c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe23806b110 tx=0x7fe22802c490 comp rx=0 tx=0).stop 2024-09-13T05:44:26.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe23e5e2640 1 -- 172.21.15.139:0/283250145 shutdown_connections 2024-09-13T05:44:26.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe23e5e2640 1 --2- 172.21.15.139:0/283250145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe224003530 0x7fe2240059c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:26.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe23e5e2640 1 -- 172.21.15.139:0/283250145 >> 172.21.15.139:0/283250145 conn(0x7fe2380fd210 msgr2=0x7fe2380ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:26.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe23e5e2640 1 -- 172.21.15.139:0/283250145 shutdown_connections 2024-09-13T05:44:26.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe23e5e2640 1 -- 172.21.15.139:0/283250145 wait complete. 2024-09-13T05:44:26.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe23e5e2640 1 Processor -- start 2024-09-13T05:44:26.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe23e5e2640 1 -- start start 2024-09-13T05:44:26.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe23e5e2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe238197a90 0x7fe238197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:26.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe23e5e2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2381983b0 0x7fe23819d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:26.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe23e5e2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe238109cf0 con 0x7fe238197a90 2024-09-13T05:44:26.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe23e5e2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe238109b70 con 0x7fe2381983b0 2024-09-13T05:44:26.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe237fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe238197a90 0x7fe238197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:26.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe22ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2381983b0 0x7fe23819d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:26.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe237fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe238197a90 0x7fe238197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.139:48678/0 (socket says 172.21.15.139:48678) 2024-09-13T05:44:26.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe237fff640 1 -- 172.21.15.139:0/3357170296 learned_addr learned my addr 172.21.15.139:0/3357170296 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T05:44:26.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe22ffff640 1 -- 172.21.15.139:0/3357170296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2381983b0 msgr2=0x7fe23819d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T05:44:26.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe22ffff640 1 -- 172.21.15.139:0/3357170296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2381983b0 msgr2=0x7fe23819d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T05:44:26.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe22ffff640 1 --2- 172.21.15.139:0/3357170296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2381983b0 0x7fe23819d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T05:44:26.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe22ffff640 1 --2- 172.21.15.139:0/3357170296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2381983b0 0x7fe23819d370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T05:44:26.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe237fff640 1 -- 172.21.15.139:0/3357170296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2381983b0 msgr2=0x7fe23819d370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T05:44:26.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe237fff640 1 --2- 172.21.15.139:0/3357170296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2381983b0 0x7fe23819d370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:26.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.600+0000 7fe237fff640 1 -- 172.21.15.139:0/3357170296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23819d9e0 con 0x7fe238197a90 2024-09-13T05:44:26.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.604+0000 7fe237fff640 1 --2- 172.21.15.139:0/3357170296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe238197a90 0x7fe238197e70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe228005f30 tx=0x7fe2280339a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:26.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.604+0000 7fe235ffb640 1 -- 172.21.15.139:0/3357170296 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe228038040 con 0x7fe238197a90 2024-09-13T05:44:26.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.604+0000 7fe23e5e2640 1 -- 172.21.15.139:0/3357170296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe23819dc70 con 0x7fe238197a90 2024-09-13T05:44:26.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.604+0000 7fe235ffb640 1 -- 172.21.15.139:0/3357170296 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fe228032c90 con 0x7fe238197a90 2024-09-13T05:44:26.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.604+0000 7fe235ffb640 1 -- 172.21.15.139:0/3357170296 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe22803ec40 con 0x7fe238197a90 2024-09-13T05:44:26.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.604+0000 7fe23e5e2640 1 -- 172.21.15.139:0/3357170296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2381a24e0 con 0x7fe238197a90 2024-09-13T05:44:26.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.604+0000 7fe23e5e2640 1 -- 172.21.15.139:0/3357170296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe23806b640 con 0x7fe238197a90 2024-09-13T05:44:26.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.604+0000 7fe235ffb640 1 -- 172.21.15.139:0/3357170296 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) ==== 51786+0+0 (secure 0 0 0) 0x7fe228046020 con 0x7fe238197a90 2024-09-13T05:44:26.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.604+0000 7fe235ffb640 1 --2- 172.21.15.139:0/3357170296 >> v2:172.21.15.79:6800/614049769 conn(0x7fe21803f4b0 0x7fe218041970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:26.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.604+0000 7fe235ffb640 1 -- 172.21.15.139:0/3357170296 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7fe228076cc0 con 0x7fe238197a90 2024-09-13T05:44:26.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.604+0000 7fe22ffff640 1 --2- 172.21.15.139:0/3357170296 >> v2:172.21.15.79:6800/614049769 conn(0x7fe21803f4b0 0x7fe218041970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:26.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.604+0000 7fe22ffff640 1 --2- 172.21.15.139:0/3357170296 >> v2:172.21.15.79:6800/614049769 conn(0x7fe21803f4b0 0x7fe218041970 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe220006fd0 tx=0x7fe220008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:26.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.616+0000 7fe235ffb640 1 -- 172.21.15.139:0/3357170296 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7fe22807d080 con 0x7fe238197a90 2024-09-13T05:44:26.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:20.913954+0000 mgr.y (mgr.14152) 51 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:20.913954+0000 mgr.y (mgr.14152) 51 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:21.247927+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:44:26.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:21.247927+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:44:26.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:21.248351+0000 mon.a (mon.0) 150 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:26.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:21.248351+0000 mon.a (mon.0) 150 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:26.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:21.268371+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:21.268371+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:22.242354+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:22.242354+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:22.914395+0000 mgr.y (mgr.14152) 52 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:22.914395+0000 mgr.y (mgr.14152) 52 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:23.242556+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:23.242556+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:23.244496+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-13T05:44:26.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:23.244496+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-13T05:44:26.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:24.243122+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:24.243122+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:24.914831+0000 mgr.y (mgr.14152) 53 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:24.914831+0000 mgr.y (mgr.14152) 53 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:25.242626+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:25.242626+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.623 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:25.728608+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:26.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:25.728608+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:26.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:26.242942+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:26.242942+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.288643+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-13T05:44:26.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.288643+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-13T05:44:26.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296192+0000 mon.a (mon.0) 159 : cluster [DBG] monmap epoch 2 2024-09-13T05:44:26.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296192+0000 mon.a (mon.0) 159 : cluster [DBG] monmap epoch 2 2024-09-13T05:44:26.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296223+0000 mon.a (mon.0) 160 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:26.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296223+0000 mon.a (mon.0) 160 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:26.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296240+0000 mon.a (mon.0) 161 : cluster [DBG] last_changed 2024-09-13T05:44:21.242093+0000 2024-09-13T05:44:26.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296240+0000 mon.a (mon.0) 161 : cluster [DBG] last_changed 2024-09-13T05:44:21.242093+0000 2024-09-13T05:44:26.624 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296261+0000 mon.a (mon.0) 162 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:44:26.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296261+0000 mon.a (mon.0) 162 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:44:26.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296283+0000 mon.a (mon.0) 163 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:44:26.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296283+0000 mon.a (mon.0) 163 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:44:26.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296301+0000 mon.a (mon.0) 164 : cluster [DBG] election_strategy: 1 2024-09-13T05:44:26.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296301+0000 mon.a (mon.0) 164 : cluster [DBG] election_strategy: 1 2024-09-13T05:44:26.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296323+0000 mon.a (mon.0) 165 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:44:26.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296323+0000 mon.a (mon.0) 165 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:44:26.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296342+0000 mon.a (mon.0) 166 : cluster [DBG] 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-13T05:44:26.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.296342+0000 mon.a (mon.0) 166 : cluster [DBG] 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-13T05:44:26.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.297382+0000 mon.a (mon.0) 167 : cluster [DBG] fsmap 2024-09-13T05:44:26.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.297382+0000 mon.a (mon.0) 167 : cluster [DBG] fsmap 2024-09-13T05:44:26.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.297434+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:26.625 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.297434+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:26.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.297711+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e14: y(active, since 69s) 2024-09-13T05:44:26.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.297711+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e14: y(active, since 69s) 2024-09-13T05:44:26.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.297957+0000 mon.a (mon.0) 170 : cluster [INF] overall HEALTH_OK 2024-09-13T05:44:26.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.297957+0000 mon.a (mon.0) 170 : cluster [INF] overall HEALTH_OK 2024-09-13T05:44:26.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:26.304216+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:26.304216+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:26.311627+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:26.311627+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:26.319387+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:26.319387+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:26.326420+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:26 smithi139 bash[24829]: audit 2024-09-13T05:44:26.326420+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:20.913954+0000 mgr.y (mgr.14152) 51 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:20.913954+0000 mgr.y (mgr.14152) 51 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:21.247927+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:44:26.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:21.247927+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:44:26.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:21.248351+0000 mon.a (mon.0) 150 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:26.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:21.248351+0000 mon.a (mon.0) 150 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:26.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:21.268371+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:21.268371+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:22.242354+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:22.242354+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:22.914395+0000 mgr.y (mgr.14152) 52 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:22.914395+0000 mgr.y (mgr.14152) 52 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:23.242556+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:23.242556+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:23.244496+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-13T05:44:26.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:23.244496+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-13T05:44:26.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:24.243122+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:24.243122+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:24.914831+0000 mgr.y (mgr.14152) 53 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:24.914831+0000 mgr.y (mgr.14152) 53 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:26.740 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:25.242626+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:25.242626+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:25.728608+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:26.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:25.728608+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:26.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:26.242942+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:26.242942+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:26.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.288643+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-13T05:44:26.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.288643+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-13T05:44:26.741 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296192+0000 mon.a (mon.0) 159 : cluster [DBG] monmap epoch 2 2024-09-13T05:44:26.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296192+0000 mon.a (mon.0) 159 : cluster [DBG] monmap epoch 2 2024-09-13T05:44:26.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296223+0000 mon.a (mon.0) 160 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:26.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296223+0000 mon.a (mon.0) 160 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:26.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296240+0000 mon.a (mon.0) 161 : cluster [DBG] last_changed 2024-09-13T05:44:21.242093+0000 2024-09-13T05:44:26.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296240+0000 mon.a (mon.0) 161 : cluster [DBG] last_changed 2024-09-13T05:44:21.242093+0000 2024-09-13T05:44:26.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296261+0000 mon.a (mon.0) 162 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:44:26.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296261+0000 mon.a (mon.0) 162 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:44:26.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296283+0000 mon.a (mon.0) 163 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:44:26.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296283+0000 mon.a (mon.0) 163 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:44:26.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296301+0000 mon.a (mon.0) 164 : cluster [DBG] election_strategy: 1 2024-09-13T05:44:26.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296301+0000 mon.a (mon.0) 164 : cluster [DBG] election_strategy: 1 2024-09-13T05:44:26.742 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296323+0000 mon.a (mon.0) 165 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:44:26.743 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296323+0000 mon.a (mon.0) 165 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:44:26.743 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296342+0000 mon.a (mon.0) 166 : cluster [DBG] 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-13T05:44:26.743 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.296342+0000 mon.a (mon.0) 166 : cluster [DBG] 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-13T05:44:26.743 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.297382+0000 mon.a (mon.0) 167 : cluster [DBG] fsmap 2024-09-13T05:44:26.743 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.297382+0000 mon.a (mon.0) 167 : cluster [DBG] fsmap 2024-09-13T05:44:26.743 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.297434+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:26.743 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.297434+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:26.743 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.297711+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e14: y(active, since 69s) 2024-09-13T05:44:26.743 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.297711+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e14: y(active, since 69s) 2024-09-13T05:44:26.744 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.297957+0000 mon.a (mon.0) 170 : cluster [INF] overall HEALTH_OK 2024-09-13T05:44:26.744 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.297957+0000 mon.a (mon.0) 170 : cluster [INF] overall HEALTH_OK 2024-09-13T05:44:26.744 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:26.304216+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.744 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:26.304216+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.744 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:26.311627+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.744 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:26.311627+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.744 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:26.319387+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.744 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:26.319387+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.744 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:26.326420+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.744 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:26 smithi079 bash[22814]: audit 2024-09-13T05:44:26.326420+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:26.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.872+0000 7fe23e5e2640 1 -- 172.21.15.139:0/3357170296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe238191300 con 0x7fe238197a90 2024-09-13T05:44:26.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.872+0000 7fe235ffb640 1 -- 172.21.15.139:0/3357170296 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fe22804d020 con 0x7fe238197a90 2024-09-13T05:44:26.877 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 2 2024-09-13T05:44:26.877 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T05:44:26.878 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":2,"fsid":"bf551932-7192-11ef-bceb-c7b262605968","modified":"2024-09-13T05:44:21.242093Z","created":"2024-09-13T05:42:06.711537Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T05:44:26.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.876+0000 7fe23e5e2640 1 -- 172.21.15.139:0/3357170296 >> v2:172.21.15.79:6800/614049769 conn(0x7fe21803f4b0 msgr2=0x7fe218041970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:26.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.876+0000 7fe23e5e2640 1 --2- 172.21.15.139:0/3357170296 >> v2:172.21.15.79:6800/614049769 conn(0x7fe21803f4b0 0x7fe218041970 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe220006fd0 tx=0x7fe220008040 comp rx=0 tx=0).stop 2024-09-13T05:44:26.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.876+0000 7fe23e5e2640 1 -- 172.21.15.139:0/3357170296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe238197a90 msgr2=0x7fe238197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:26.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.876+0000 7fe23e5e2640 1 --2- 172.21.15.139:0/3357170296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe238197a90 0x7fe238197e70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe228005f30 tx=0x7fe2280339a0 comp rx=0 tx=0).stop 2024-09-13T05:44:26.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.876+0000 7fe23e5e2640 1 -- 172.21.15.139:0/3357170296 shutdown_connections 2024-09-13T05:44:26.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.876+0000 7fe23e5e2640 1 --2- 172.21.15.139:0/3357170296 >> v2:172.21.15.79:6800/614049769 conn(0x7fe21803f4b0 0x7fe218041970 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:26.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.876+0000 7fe23e5e2640 1 --2- 172.21.15.139:0/3357170296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2381983b0 0x7fe23819d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:26.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.876+0000 7fe23e5e2640 1 --2- 172.21.15.139:0/3357170296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe238197a90 0x7fe238197e70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:26.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.876+0000 7fe23e5e2640 1 -- 172.21.15.139:0/3357170296 >> 172.21.15.139:0/3357170296 conn(0x7fe2380fd210 msgr2=0x7fe238106db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:26.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.876+0000 7fe23e5e2640 1 -- 172.21.15.139:0/3357170296 shutdown_connections 2024-09-13T05:44:26.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:26.876+0000 7fe23e5e2640 1 -- 172.21.15.139:0/3357170296 wait complete. 2024-09-13T05:44:27.605 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:27 smithi139 bash[24829]: audit 2024-09-13T05:44:26.368425+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:27.605 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:27 smithi139 bash[24829]: audit 2024-09-13T05:44:26.368425+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:27.605 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:27 smithi139 bash[24829]: audit 2024-09-13T05:44:26.728803+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:27.605 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:27 smithi139 bash[24829]: audit 2024-09-13T05:44:26.728803+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:27.605 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:27 smithi139 bash[24829]: audit 2024-09-13T05:44:26.877695+0000 mon.a (mon.0) 177 : audit [DBG] from='client.? 172.21.15.139:0/3357170296' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:27.605 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:27 smithi139 bash[24829]: audit 2024-09-13T05:44:26.877695+0000 mon.a (mon.0) 177 : audit [DBG] from='client.? 172.21.15.139:0/3357170296' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:27.605 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:27 smithi139 bash[24829]: audit 2024-09-13T05:44:27.204861+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:27.606 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:27 smithi139 bash[24829]: audit 2024-09-13T05:44:27.204861+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:27.606 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:27 smithi139 bash[24829]: audit 2024-09-13T05:44:27.243246+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:27.606 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:27 smithi139 bash[24829]: audit 2024-09-13T05:44:27.243246+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:27.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:27 smithi079 bash[22814]: audit 2024-09-13T05:44:26.368425+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:27.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:27 smithi079 bash[22814]: audit 2024-09-13T05:44:26.368425+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:27.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:27 smithi079 bash[22814]: audit 2024-09-13T05:44:26.728803+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:27.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:27 smithi079 bash[22814]: audit 2024-09-13T05:44:26.728803+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:27.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:27 smithi079 bash[22814]: audit 2024-09-13T05:44:26.877695+0000 mon.a (mon.0) 177 : audit [DBG] from='client.? 172.21.15.139:0/3357170296' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:27.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:27 smithi079 bash[22814]: audit 2024-09-13T05:44:26.877695+0000 mon.a (mon.0) 177 : audit [DBG] from='client.? 172.21.15.139:0/3357170296' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:27.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:27 smithi079 bash[22814]: audit 2024-09-13T05:44:27.204861+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:27.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:27 smithi079 bash[22814]: audit 2024-09-13T05:44:27.204861+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:27.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:27 smithi079 bash[22814]: audit 2024-09-13T05:44:27.243246+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:27.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:27 smithi079 bash[22814]: audit 2024-09-13T05:44:27.243246+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:28.607 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T05:44:28.608 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T05:44:28.738 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:44:28 smithi079 bash[23069]: debug 2024-09-13T05:44:28.241+0000 7f7a9ba40640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T05:44:32.397 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T05:44:33.121 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.915234+0000 mgr.y (mgr.14152) 54 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.122 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:26.915234+0000 mgr.y (mgr.14152) 54 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.122 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:27.736682+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:44:33.122 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:27.736682+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:44:33.122 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:27.737183+0000 mon.a (mon.0) 182 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:33.122 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:27.737183+0000 mon.a (mon.0) 182 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:33.122 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:27.738451+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-13T05:44:33.122 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:27.738451+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-13T05:44:33.122 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:27.756487+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.122 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:27.756487+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.122 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:27.756867+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.122 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:27.756867+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.123 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:28.729143+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.123 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:28.729143+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.123 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:28.915597+0000 mgr.y (mgr.14152) 55 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.123 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:28.915597+0000 mgr.y (mgr.14152) 55 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.123 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:29.729296+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.123 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:29.729296+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.123 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:29.732316+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-13T05:44:33.123 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:29.732316+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-13T05:44:33.123 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:30.729597+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.124 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:30.729597+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.124 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:30.915963+0000 mgr.y (mgr.14152) 56 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.124 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:30.915963+0000 mgr.y (mgr.14152) 56 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.124 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:31.729215+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.124 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:31.729215+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.124 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:32.729679+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.124 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:32.729679+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.124 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.741796+0000 mon.a (mon.0) 190 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:33.124 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.741796+0000 mon.a (mon.0) 190 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:33.124 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.783671+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-13T05:44:33.124 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.783671+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-13T05:44:33.124 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.792967+0000 mon.a (mon.0) 192 : cluster [DBG] monmap epoch 3 2024-09-13T05:44:33.124 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.792967+0000 mon.a (mon.0) 192 : cluster [DBG] monmap epoch 3 2024-09-13T05:44:33.125 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793028+0000 mon.a (mon.0) 193 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:33.125 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793028+0000 mon.a (mon.0) 193 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:33.125 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793071+0000 mon.a (mon.0) 194 : cluster [DBG] last_changed 2024-09-13T05:44:27.730262+0000 2024-09-13T05:44:33.125 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793071+0000 mon.a (mon.0) 194 : cluster [DBG] last_changed 2024-09-13T05:44:27.730262+0000 2024-09-13T05:44:33.125 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793116+0000 mon.a (mon.0) 195 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:44:33.125 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793116+0000 mon.a (mon.0) 195 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:44:33.125 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793153+0000 mon.a (mon.0) 196 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:44:33.125 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793153+0000 mon.a (mon.0) 196 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:44:33.125 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793198+0000 mon.a (mon.0) 197 : cluster [DBG] election_strategy: 1 2024-09-13T05:44:33.125 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793198+0000 mon.a (mon.0) 197 : cluster [DBG] election_strategy: 1 2024-09-13T05:44:33.125 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793249+0000 mon.a (mon.0) 198 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:44:33.125 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793249+0000 mon.a (mon.0) 198 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:44:33.125 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793286+0000 mon.a (mon.0) 199 : cluster [DBG] 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-13T05:44:33.125 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793286+0000 mon.a (mon.0) 199 : cluster [DBG] 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-13T05:44:33.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793329+0000 mon.a (mon.0) 200 : cluster [DBG] 2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2024-09-13T05:44:33.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.793329+0000 mon.a (mon.0) 200 : cluster [DBG] 2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2024-09-13T05:44:33.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.811937+0000 mon.a (mon.0) 201 : cluster [DBG] fsmap 2024-09-13T05:44:33.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.811937+0000 mon.a (mon.0) 201 : cluster [DBG] fsmap 2024-09-13T05:44:33.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.811987+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:33.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.811987+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:33.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.812287+0000 mon.a (mon.0) 203 : cluster [DBG] mgrmap e14: y(active, since 75s) 2024-09-13T05:44:33.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.812287+0000 mon.a (mon.0) 203 : cluster [DBG] mgrmap e14: y(active, since 75s) 2024-09-13T05:44:33.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.812526+0000 mon.a (mon.0) 204 : cluster [INF] overall HEALTH_OK 2024-09-13T05:44:33.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.812526+0000 mon.a (mon.0) 204 : cluster [INF] overall HEALTH_OK 2024-09-13T05:44:33.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:32.819570+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:32.819570+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:32.827500+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.127 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:32.827500+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.127 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:32.835866+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.127 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:32.835866+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.127 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:32.844153+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.127 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:32 smithi139 bash[24829]: audit 2024-09-13T05:44:32.844153+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.915234+0000 mgr.y (mgr.14152) 54 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:26.915234+0000 mgr.y (mgr.14152) 54 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:27.736682+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:44:33.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:27.736682+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:44:33.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:27.737183+0000 mon.a (mon.0) 182 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:33.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:27.737183+0000 mon.a (mon.0) 182 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:33.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:27.738451+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-13T05:44:33.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:27.738451+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-13T05:44:33.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:27.756487+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:27.756487+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:27.756867+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:27.756867+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:28.729143+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:28.729143+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:28.915597+0000 mgr.y (mgr.14152) 55 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:28.915597+0000 mgr.y (mgr.14152) 55 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:29.729296+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:29.729296+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:29.732316+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-13T05:44:33.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:29.732316+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-13T05:44:33.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:30.729597+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:20.913954+0000 mgr.y (mgr.14152) 51 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:20.913954+0000 mgr.y (mgr.14152) 51 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:21.247927+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:44:33.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:21.247927+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:44:33.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:21.248351+0000 mon.a (mon.0) 150 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:33.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:21.248351+0000 mon.a (mon.0) 150 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:33.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:21.268371+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:21.268371+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:22.242354+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:22.242354+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:22.914395+0000 mgr.y (mgr.14152) 52 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:22.914395+0000 mgr.y (mgr.14152) 52 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:23.242556+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:23.242556+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:23.244496+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-13T05:44:33.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:23.244496+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-13T05:44:33.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:24.243122+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:24.243122+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:24.914831+0000 mgr.y (mgr.14152) 53 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:24.914831+0000 mgr.y (mgr.14152) 53 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:25.242626+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:30.729597+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:30.915963+0000 mgr.y (mgr.14152) 56 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:30.915963+0000 mgr.y (mgr.14152) 56 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:31.729215+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:31.729215+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:32.729679+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:32.729679+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.741796+0000 mon.a (mon.0) 190 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:33.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.741796+0000 mon.a (mon.0) 190 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:33.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.783671+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-13T05:44:33.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.783671+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-13T05:44:33.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.792967+0000 mon.a (mon.0) 192 : cluster [DBG] monmap epoch 3 2024-09-13T05:44:33.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.792967+0000 mon.a (mon.0) 192 : cluster [DBG] monmap epoch 3 2024-09-13T05:44:33.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793028+0000 mon.a (mon.0) 193 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:33.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793028+0000 mon.a (mon.0) 193 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:33.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793071+0000 mon.a (mon.0) 194 : cluster [DBG] last_changed 2024-09-13T05:44:27.730262+0000 2024-09-13T05:44:33.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793071+0000 mon.a (mon.0) 194 : cluster [DBG] last_changed 2024-09-13T05:44:27.730262+0000 2024-09-13T05:44:33.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793116+0000 mon.a (mon.0) 195 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:44:33.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793116+0000 mon.a (mon.0) 195 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:44:33.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793153+0000 mon.a (mon.0) 196 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:44:33.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793153+0000 mon.a (mon.0) 196 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:44:33.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793198+0000 mon.a (mon.0) 197 : cluster [DBG] election_strategy: 1 2024-09-13T05:44:33.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793198+0000 mon.a (mon.0) 197 : cluster [DBG] election_strategy: 1 2024-09-13T05:44:33.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793249+0000 mon.a (mon.0) 198 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:44:33.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793249+0000 mon.a (mon.0) 198 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:44:33.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:25.242626+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:25.728608+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:25.728608+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.242942+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.242942+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.288643+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-13T05:44:33.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.288643+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-13T05:44:33.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296192+0000 mon.a (mon.0) 159 : cluster [DBG] monmap epoch 2 2024-09-13T05:44:33.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296192+0000 mon.a (mon.0) 159 : cluster [DBG] monmap epoch 2 2024-09-13T05:44:33.246 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296223+0000 mon.a (mon.0) 160 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:33.246 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296223+0000 mon.a (mon.0) 160 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:33.246 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296240+0000 mon.a (mon.0) 161 : cluster [DBG] last_changed 2024-09-13T05:44:21.242093+0000 2024-09-13T05:44:33.246 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296240+0000 mon.a (mon.0) 161 : cluster [DBG] last_changed 2024-09-13T05:44:21.242093+0000 2024-09-13T05:44:33.246 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296261+0000 mon.a (mon.0) 162 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:44:33.246 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296261+0000 mon.a (mon.0) 162 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:44:33.246 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296283+0000 mon.a (mon.0) 163 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:44:33.246 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296283+0000 mon.a (mon.0) 163 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:44:33.246 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296301+0000 mon.a (mon.0) 164 : cluster [DBG] election_strategy: 1 2024-09-13T05:44:33.246 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296301+0000 mon.a (mon.0) 164 : cluster [DBG] election_strategy: 1 2024-09-13T05:44:33.246 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296323+0000 mon.a (mon.0) 165 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:44:33.247 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296323+0000 mon.a (mon.0) 165 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:44:33.247 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296342+0000 mon.a (mon.0) 166 : cluster [DBG] 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-13T05:44:33.247 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.296342+0000 mon.a (mon.0) 166 : cluster [DBG] 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-13T05:44:33.247 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.297382+0000 mon.a (mon.0) 167 : cluster [DBG] fsmap 2024-09-13T05:44:33.247 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.297382+0000 mon.a (mon.0) 167 : cluster [DBG] fsmap 2024-09-13T05:44:33.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793286+0000 mon.a (mon.0) 199 : cluster [DBG] 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-13T05:44:33.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793286+0000 mon.a (mon.0) 199 : cluster [DBG] 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-13T05:44:33.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793329+0000 mon.a (mon.0) 200 : cluster [DBG] 2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2024-09-13T05:44:33.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.793329+0000 mon.a (mon.0) 200 : cluster [DBG] 2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2024-09-13T05:44:33.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.811937+0000 mon.a (mon.0) 201 : cluster [DBG] fsmap 2024-09-13T05:44:33.247 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.811937+0000 mon.a (mon.0) 201 : cluster [DBG] fsmap 2024-09-13T05:44:33.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.811987+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:33.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.811987+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:33.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.812287+0000 mon.a (mon.0) 203 : cluster [DBG] mgrmap e14: y(active, since 75s) 2024-09-13T05:44:33.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.812287+0000 mon.a (mon.0) 203 : cluster [DBG] mgrmap e14: y(active, since 75s) 2024-09-13T05:44:33.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.812526+0000 mon.a (mon.0) 204 : cluster [INF] overall HEALTH_OK 2024-09-13T05:44:33.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.812526+0000 mon.a (mon.0) 204 : cluster [INF] overall HEALTH_OK 2024-09-13T05:44:33.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:32.819570+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:32.819570+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:32.827500+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:32.827500+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:32.835866+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:32.835866+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:32.844153+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.248 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[22814]: audit 2024-09-13T05:44:32.844153+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.249 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.297434+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:33.249 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.297434+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:33.249 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.297711+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e14: y(active, since 69s) 2024-09-13T05:44:33.249 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.297711+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e14: y(active, since 69s) 2024-09-13T05:44:33.249 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.297957+0000 mon.a (mon.0) 170 : cluster [INF] overall HEALTH_OK 2024-09-13T05:44:33.249 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.297957+0000 mon.a (mon.0) 170 : cluster [INF] overall HEALTH_OK 2024-09-13T05:44:33.249 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.304216+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.304216+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.311627+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.311627+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.319387+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.319387+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.326420+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.326420+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.368425+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.368425+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.728803+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.728803+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.877695+0000 mon.a (mon.0) 177 : audit [DBG] from='client.? 172.21.15.139:0/3357170296' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:26.877695+0000 mon.a (mon.0) 177 : audit [DBG] from='client.? 172.21.15.139:0/3357170296' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:27.204861+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.250 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:27.204861+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:27.243246+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:27.243246+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.915234+0000 mgr.y (mgr.14152) 54 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:26.915234+0000 mgr.y (mgr.14152) 54 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:27.736682+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:27.736682+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:27.737183+0000 mon.a (mon.0) 182 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:27.737183+0000 mon.a (mon.0) 182 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:27.738451+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:27.738451+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:27.756487+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:27.756487+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:27.756867+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:27.756867+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.251 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:28.729143+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.252 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:28.729143+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.252 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:28.915597+0000 mgr.y (mgr.14152) 55 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.252 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:28.915597+0000 mgr.y (mgr.14152) 55 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.252 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:29.729296+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.252 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:29.729296+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.252 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:29.732316+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-13T05:44:33.252 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:29.732316+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-13T05:44:33.252 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:30.729597+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.252 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:30.729597+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.252 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:30.915963+0000 mgr.y (mgr.14152) 56 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.252 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:30.915963+0000 mgr.y (mgr.14152) 56 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:33.252 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:31.729215+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.252 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:31.729215+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:32.729679+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:32.729679+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.741796+0000 mon.a (mon.0) 190 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.741796+0000 mon.a (mon.0) 190 : cluster [INF] mon.a calling monitor election 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.783671+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.783671+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.792967+0000 mon.a (mon.0) 192 : cluster [DBG] monmap epoch 3 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.792967+0000 mon.a (mon.0) 192 : cluster [DBG] monmap epoch 3 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793028+0000 mon.a (mon.0) 193 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793028+0000 mon.a (mon.0) 193 : cluster [DBG] fsid bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793071+0000 mon.a (mon.0) 194 : cluster [DBG] last_changed 2024-09-13T05:44:27.730262+0000 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793071+0000 mon.a (mon.0) 194 : cluster [DBG] last_changed 2024-09-13T05:44:27.730262+0000 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793116+0000 mon.a (mon.0) 195 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793116+0000 mon.a (mon.0) 195 : cluster [DBG] created 2024-09-13T05:42:06.711537+0000 2024-09-13T05:44:33.253 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793153+0000 mon.a (mon.0) 196 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793153+0000 mon.a (mon.0) 196 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793198+0000 mon.a (mon.0) 197 : cluster [DBG] election_strategy: 1 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793198+0000 mon.a (mon.0) 197 : cluster [DBG] election_strategy: 1 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793249+0000 mon.a (mon.0) 198 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793249+0000 mon.a (mon.0) 198 : cluster [DBG] 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793286+0000 mon.a (mon.0) 199 : cluster [DBG] 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793286+0000 mon.a (mon.0) 199 : cluster [DBG] 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793329+0000 mon.a (mon.0) 200 : cluster [DBG] 2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.793329+0000 mon.a (mon.0) 200 : cluster [DBG] 2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.811937+0000 mon.a (mon.0) 201 : cluster [DBG] fsmap 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.811937+0000 mon.a (mon.0) 201 : cluster [DBG] fsmap 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.811987+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.811987+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.812287+0000 mon.a (mon.0) 203 : cluster [DBG] mgrmap e14: y(active, since 75s) 2024-09-13T05:44:33.254 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.812287+0000 mon.a (mon.0) 203 : cluster [DBG] mgrmap e14: y(active, since 75s) 2024-09-13T05:44:33.255 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.812526+0000 mon.a (mon.0) 204 : cluster [INF] overall HEALTH_OK 2024-09-13T05:44:33.255 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.812526+0000 mon.a (mon.0) 204 : cluster [INF] overall HEALTH_OK 2024-09-13T05:44:33.255 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:32.819570+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.255 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:32.819570+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.255 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:32.827500+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.255 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:32.827500+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.255 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:32.835866+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.255 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:32.835866+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.255 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:32.844153+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.255 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:32 smithi079 bash[31923]: audit 2024-09-13T05:44:32.844153+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:33.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.596+0000 7f2cccdc4640 1 -- 172.21.15.139:0/3817511376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc806a980 msgr2=0x7f2cc806ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:33.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.596+0000 7f2cccdc4640 1 --2- 172.21.15.139:0/3817511376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc806a980 0x7f2cc806ad60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009880 tx=0x7f2cb802a5d0 comp rx=0 tx=0).stop 2024-09-13T05:44:33.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.596+0000 7f2cccdc4640 1 -- 172.21.15.139:0/3817511376 shutdown_connections 2024-09-13T05:44:33.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.596+0000 7f2cccdc4640 1 --2- 172.21.15.139:0/3817511376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc806a980 0x7f2cc806ad60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:33.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.596+0000 7f2cccdc4640 1 -- 172.21.15.139:0/3817511376 >> 172.21.15.139:0/3817511376 conn(0x7f2cc8077170 msgr2=0x7f2cc8077580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:33.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.596+0000 7f2cccdc4640 1 -- 172.21.15.139:0/3817511376 shutdown_connections 2024-09-13T05:44:33.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.596+0000 7f2cccdc4640 1 -- 172.21.15.139:0/3817511376 wait complete. 2024-09-13T05:44:33.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cccdc4640 1 Processor -- start 2024-09-13T05:44:33.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cccdc4640 1 -- start start 2024-09-13T05:44:33.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cccdc4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc806a980 0x7f2cc8197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:33.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cccdc4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cc8197f50 0x7f2cc819d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:33.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cccdc4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cc819d830 0x7f2cc819dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:33.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cccdc4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc810c1c0 con 0x7f2cc806a980 2024-09-13T05:44:33.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cccdc4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc810c040 con 0x7f2cc819d830 2024-09-13T05:44:33.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cccdc4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc810c340 con 0x7f2cc8197f50 2024-09-13T05:44:33.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc806a980 0x7f2cc8197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:33.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc6d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cc819d830 0x7f2cc819dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:33.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc806a980 0x7f2cc8197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.139:48698/0 (socket says 172.21.15.139:48698) 2024-09-13T05:44:33.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc659c640 1 -- 172.21.15.139:0/4249588109 learned_addr learned my addr 172.21.15.139:0/4249588109 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T05:44:33.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc5d9b640 1 --2- 172.21.15.139:0/4249588109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cc8197f50 0x7f2cc819d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:33.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc6d9d640 1 -- 172.21.15.139:0/4249588109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cc819d830 msgr2=0x7f2cc819dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-13T05:44:33.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc6d9d640 1 -- 172.21.15.139:0/4249588109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cc819d830 msgr2=0x7f2cc819dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T05:44:33.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc6d9d640 1 --2- 172.21.15.139:0/4249588109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cc819d830 0x7f2cc819dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T05:44:33.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc6d9d640 1 --2- 172.21.15.139:0/4249588109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cc819d830 0x7f2cc819dce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T05:44:33.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc5d9b640 1 -- 172.21.15.139:0/4249588109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cc8197f50 msgr2=0x7f2cc819d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T05:44:33.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc5d9b640 1 -- 172.21.15.139:0/4249588109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cc8197f50 msgr2=0x7f2cc819d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T05:44:33.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc5d9b640 1 --2- 172.21.15.139:0/4249588109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cc8197f50 0x7f2cc819d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T05:44:33.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc5d9b640 1 --2- 172.21.15.139:0/4249588109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cc8197f50 0x7f2cc819d2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T05:44:33.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc659c640 1 -- 172.21.15.139:0/4249588109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cc8197f50 msgr2=0x7f2cc819d2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T05:44:33.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc659c640 1 --2- 172.21.15.139:0/4249588109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cc8197f50 0x7f2cc819d2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:33.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc659c640 1 -- 172.21.15.139:0/4249588109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cc819d830 msgr2=0x7f2cc819dce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T05:44:33.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc659c640 1 --2- 172.21.15.139:0/4249588109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cc819d830 0x7f2cc819dce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:33.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc659c640 1 -- 172.21.15.139:0/4249588109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc81a4470 con 0x7f2cc806a980 2024-09-13T05:44:33.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc659c640 1 --2- 172.21.15.139:0/4249588109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc806a980 0x7f2cc8197a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8031440 tx=0x7f2cb8032bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:33.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cb77fe640 1 -- 172.21.15.139:0/4249588109 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb803f030 con 0x7f2cc806a980 2024-09-13T05:44:33.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cccdc4640 1 -- 172.21.15.139:0/4249588109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc81a4700 con 0x7f2cc806a980 2024-09-13T05:44:33.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cccdc4640 1 -- 172.21.15.139:0/4249588109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc81a4c10 con 0x7f2cc806a980 2024-09-13T05:44:33.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cb77fe640 1 -- 172.21.15.139:0/4249588109 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f2cb80044c0 con 0x7f2cc806a980 2024-09-13T05:44:33.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cb77fe640 1 -- 172.21.15.139:0/4249588109 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8049060 con 0x7f2cc806a980 2024-09-13T05:44:33.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cccdc4640 1 -- 172.21.15.139:0/4249588109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca80050b0 con 0x7f2cc806a980 2024-09-13T05:44:33.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cb77fe640 1 -- 172.21.15.139:0/4249588109 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) ==== 51786+0+0 (secure 0 0 0) 0x7f2cb8042030 con 0x7f2cc806a980 2024-09-13T05:44:33.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cb77fe640 1 --2- 172.21.15.139:0/4249588109 >> v2:172.21.15.79:6800/614049769 conn(0x7f2cb003fb90 0x7f2cb0042050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:33.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cb77fe640 1 -- 172.21.15.139:0/4249588109 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f2cb80747a0 con 0x7f2cc806a980 2024-09-13T05:44:33.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.600+0000 7f2cc5d9b640 1 --2- 172.21.15.139:0/4249588109 >> v2:172.21.15.79:6800/614049769 conn(0x7f2cb003fb90 0x7f2cb0042050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:33.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.604+0000 7f2cc5d9b640 1 --2- 172.21.15.139:0/4249588109 >> v2:172.21.15.79:6800/614049769 conn(0x7f2cb003fb90 0x7f2cb0042050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc006fd0 tx=0x7f2cbc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:33.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.616+0000 7f2cb77fe640 1 -- 172.21.15.139:0/4249588109 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f2cb8003b20 con 0x7f2cc806a980 2024-09-13T05:44:33.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.872+0000 7f2cccdc4640 1 -- 172.21.15.139:0/4249588109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2ca80053a0 con 0x7f2cc806a980 2024-09-13T05:44:33.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.872+0000 7f2cb77fe640 1 -- 172.21.15.139:0/4249588109 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1281 (secure 0 0 0) 0x7f2cb8004040 con 0x7f2cc806a980 2024-09-13T05:44:33.876 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 3 2024-09-13T05:44:33.877 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T05:44:33.877 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":3,"fsid":"bf551932-7192-11ef-bceb-c7b262605968","modified":"2024-09-13T05:44:27.730262Z","created":"2024-09-13T05:42:06.711537Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3301","nonce":0},{"type":"v1","addr":"172.21.15.79:6790","nonce":0}]},"addr":"172.21.15.79:6790/0","public_addr":"172.21.15.79:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-13T05:44:33.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.876+0000 7f2cccdc4640 1 -- 172.21.15.139:0/4249588109 >> v2:172.21.15.79:6800/614049769 conn(0x7f2cb003fb90 msgr2=0x7f2cb0042050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:33.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.876+0000 7f2cccdc4640 1 --2- 172.21.15.139:0/4249588109 >> v2:172.21.15.79:6800/614049769 conn(0x7f2cb003fb90 0x7f2cb0042050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc006fd0 tx=0x7f2cbc008040 comp rx=0 tx=0).stop 2024-09-13T05:44:33.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.876+0000 7f2cccdc4640 1 -- 172.21.15.139:0/4249588109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc806a980 msgr2=0x7f2cc8197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:33.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.876+0000 7f2cccdc4640 1 --2- 172.21.15.139:0/4249588109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc806a980 0x7f2cc8197a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8031440 tx=0x7f2cb8032bf0 comp rx=0 tx=0).stop 2024-09-13T05:44:33.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.876+0000 7f2cccdc4640 1 -- 172.21.15.139:0/4249588109 shutdown_connections 2024-09-13T05:44:33.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.876+0000 7f2cccdc4640 1 --2- 172.21.15.139:0/4249588109 >> v2:172.21.15.79:6800/614049769 conn(0x7f2cb003fb90 0x7f2cb0042050 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:33.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.876+0000 7f2cccdc4640 1 --2- 172.21.15.139:0/4249588109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2cc8197f50 0x7f2cc819d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:33.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.876+0000 7f2cccdc4640 1 --2- 172.21.15.139:0/4249588109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cc819d830 0x7f2cc819dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:33.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.876+0000 7f2cccdc4640 1 --2- 172.21.15.139:0/4249588109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2cc806a980 0x7f2cc8197a10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:33.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.876+0000 7f2cccdc4640 1 -- 172.21.15.139:0/4249588109 >> 172.21.15.139:0/4249588109 conn(0x7f2cc8077170 msgr2=0x7f2cc8108a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:33.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.876+0000 7f2cccdc4640 1 -- 172.21.15.139:0/4249588109 shutdown_connections 2024-09-13T05:44:33.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:33.876+0000 7f2cccdc4640 1 -- 172.21.15.139:0/4249588109 wait complete. 2024-09-13T05:44:34.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.531554+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:34.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.531554+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:34.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.533019+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:34.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.533019+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:34.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.715994+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.715994+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.720799+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.720799+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.726568+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.726568+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.729913+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:34.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.729913+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:34.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.732166+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.732166+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.738483+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.738483+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.763608+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.763608+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.769055+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.769055+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.774617+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.774617+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.531554+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:34.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.531554+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:34.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.533019+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:34.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.533019+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:34.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.715994+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.715994+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.720799+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.720799+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.726568+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.726568+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.729913+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:34.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.729913+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:34.243 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.732166+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.243 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.732166+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.243 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.738483+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.243 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.738483+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.243 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.763608+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.243 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.763608+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.243 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.769055+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.243 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.769055+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.243 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.774617+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.243 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.774617+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.780309+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.780309+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.781297+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:34.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.781297+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:34.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.782740+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:34.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.782740+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:34.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.784038+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:34.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.784038+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:34.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.876610+0000 mon.a (mon.0) 224 : audit [DBG] from='client.? 172.21.15.139:0/4249588109' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:34.244 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[22814]: audit 2024-09-13T05:44:33.876610+0000 mon.a (mon.0) 224 : audit [DBG] from='client.? 172.21.15.139:0/4249588109' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:34.244 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.780309+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.244 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.780309+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.781297+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:34.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.781297+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:34.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.782740+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:34.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.782740+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:34.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.784038+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:34.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.784038+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:34.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.876610+0000 mon.a (mon.0) 224 : audit [DBG] from='client.? 172.21.15.139:0/4249588109' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:34.245 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:33 smithi079 bash[31923]: audit 2024-09-13T05:44:33.876610+0000 mon.a (mon.0) 224 : audit [DBG] from='client.? 172.21.15.139:0/4249588109' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:34.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.531554+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:34.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.531554+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:34.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.533019+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:34.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.533019+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:34.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.715994+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.715994+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.720799+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.720799+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.726568+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.726568+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.729913+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:34.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.729913+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-13T05:44:34.373 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.732166+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.373 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.732166+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.373 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.738483+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.373 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.738483+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.373 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.763608+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.373 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.763608+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.373 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.769055+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.373 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.769055+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.373 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.774617+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.373 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.774617+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.373 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.780309+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.373 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.780309+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:34.373 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.781297+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:34.374 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.781297+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:34.374 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.782740+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:34.374 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.782740+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:34.374 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.784038+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:34.374 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.784038+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:34.374 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.876610+0000 mon.a (mon.0) 224 : audit [DBG] from='client.? 172.21.15.139:0/4249588109' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:34.374 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:33 smithi139 bash[24829]: audit 2024-09-13T05:44:33.876610+0000 mon.a (mon.0) 224 : audit [DBG] from='client.? 172.21.15.139:0/4249588109' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-13T05:44:34.422 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T05:44:34.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T05:44:35.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.916322+0000 mgr.y (mgr.14152) 57 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[22814]: cluster 2024-09-13T05:44:32.916322+0000 mgr.y (mgr.14152) 57 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[22814]: cephadm 2024-09-13T05:44:33.534980+0000 mgr.y (mgr.14152) 58 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.conf 2024-09-13T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[22814]: cephadm 2024-09-13T05:44:33.534980+0000 mgr.y (mgr.14152) 58 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.conf 2024-09-13T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[22814]: cephadm 2024-09-13T05:44:33.535215+0000 mgr.y (mgr.14152) 59 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[22814]: cephadm 2024-09-13T05:44:33.535215+0000 mgr.y (mgr.14152) 59 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[22814]: cephadm 2024-09-13T05:44:33.626757+0000 mgr.y (mgr.14152) 60 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[22814]: cephadm 2024-09-13T05:44:33.626757+0000 mgr.y (mgr.14152) 60 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[22814]: cephadm 2024-09-13T05:44:33.626950+0000 mgr.y (mgr.14152) 61 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[22814]: cephadm 2024-09-13T05:44:33.626950+0000 mgr.y (mgr.14152) 61 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[22814]: cephadm 2024-09-13T05:44:33.780742+0000 mgr.y (mgr.14152) 62 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-13T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[22814]: cephadm 2024-09-13T05:44:33.780742+0000 mgr.y (mgr.14152) 62 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-13T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[22814]: cephadm 2024-09-13T05:44:33.785284+0000 mgr.y (mgr.14152) 63 : cephadm [INF] Reconfiguring daemon mon.a on smithi079 2024-09-13T05:44:35.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[22814]: cephadm 2024-09-13T05:44:33.785284+0000 mgr.y (mgr.14152) 63 : cephadm [INF] Reconfiguring daemon mon.a on smithi079 2024-09-13T05:44:35.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.916322+0000 mgr.y (mgr.14152) 57 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:35.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[31923]: cluster 2024-09-13T05:44:32.916322+0000 mgr.y (mgr.14152) 57 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:35.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[31923]: cephadm 2024-09-13T05:44:33.534980+0000 mgr.y (mgr.14152) 58 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.conf 2024-09-13T05:44:35.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[31923]: cephadm 2024-09-13T05:44:33.534980+0000 mgr.y (mgr.14152) 58 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.conf 2024-09-13T05:44:35.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[31923]: cephadm 2024-09-13T05:44:33.535215+0000 mgr.y (mgr.14152) 59 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T05:44:35.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[31923]: cephadm 2024-09-13T05:44:33.535215+0000 mgr.y (mgr.14152) 59 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T05:44:35.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[31923]: cephadm 2024-09-13T05:44:33.626757+0000 mgr.y (mgr.14152) 60 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:35.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[31923]: cephadm 2024-09-13T05:44:33.626757+0000 mgr.y (mgr.14152) 60 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:35.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[31923]: cephadm 2024-09-13T05:44:33.626950+0000 mgr.y (mgr.14152) 61 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:35.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[31923]: cephadm 2024-09-13T05:44:33.626950+0000 mgr.y (mgr.14152) 61 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:35.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[31923]: cephadm 2024-09-13T05:44:33.780742+0000 mgr.y (mgr.14152) 62 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-13T05:44:35.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[31923]: cephadm 2024-09-13T05:44:33.780742+0000 mgr.y (mgr.14152) 62 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-13T05:44:35.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[31923]: cephadm 2024-09-13T05:44:33.785284+0000 mgr.y (mgr.14152) 63 : cephadm [INF] Reconfiguring daemon mon.a on smithi079 2024-09-13T05:44:35.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:34 smithi079 bash[31923]: cephadm 2024-09-13T05:44:33.785284+0000 mgr.y (mgr.14152) 63 : cephadm [INF] Reconfiguring daemon mon.a on smithi079 2024-09-13T05:44:35.371 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:34 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.916322+0000 mgr.y (mgr.14152) 57 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:35.371 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:34 smithi139 bash[24829]: cluster 2024-09-13T05:44:32.916322+0000 mgr.y (mgr.14152) 57 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:35.371 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:34 smithi139 bash[24829]: cephadm 2024-09-13T05:44:33.534980+0000 mgr.y (mgr.14152) 58 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.conf 2024-09-13T05:44:35.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:34 smithi139 bash[24829]: cephadm 2024-09-13T05:44:33.534980+0000 mgr.y (mgr.14152) 58 : cephadm [INF] Updating smithi079:/etc/ceph/ceph.conf 2024-09-13T05:44:35.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:34 smithi139 bash[24829]: cephadm 2024-09-13T05:44:33.535215+0000 mgr.y (mgr.14152) 59 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T05:44:35.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:34 smithi139 bash[24829]: cephadm 2024-09-13T05:44:33.535215+0000 mgr.y (mgr.14152) 59 : cephadm [INF] Updating smithi139:/etc/ceph/ceph.conf 2024-09-13T05:44:35.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:34 smithi139 bash[24829]: cephadm 2024-09-13T05:44:33.626757+0000 mgr.y (mgr.14152) 60 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:35.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:34 smithi139 bash[24829]: cephadm 2024-09-13T05:44:33.626757+0000 mgr.y (mgr.14152) 60 : cephadm [INF] Updating smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:35.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:34 smithi139 bash[24829]: cephadm 2024-09-13T05:44:33.626950+0000 mgr.y (mgr.14152) 61 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:35.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:34 smithi139 bash[24829]: cephadm 2024-09-13T05:44:33.626950+0000 mgr.y (mgr.14152) 61 : cephadm [INF] Updating smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T05:44:35.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:34 smithi139 bash[24829]: cephadm 2024-09-13T05:44:33.780742+0000 mgr.y (mgr.14152) 62 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-13T05:44:35.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:34 smithi139 bash[24829]: cephadm 2024-09-13T05:44:33.780742+0000 mgr.y (mgr.14152) 62 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-13T05:44:35.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:34 smithi139 bash[24829]: cephadm 2024-09-13T05:44:33.785284+0000 mgr.y (mgr.14152) 63 : cephadm [INF] Reconfiguring daemon mon.a on smithi079 2024-09-13T05:44:35.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:34 smithi139 bash[24829]: cephadm 2024-09-13T05:44:33.785284+0000 mgr.y (mgr.14152) 63 : cephadm [INF] Reconfiguring daemon mon.a on smithi079 2024-09-13T05:44:37.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[31923]: cluster 2024-09-13T05:44:34.916742+0000 mgr.y (mgr.14152) 64 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:37.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[31923]: cluster 2024-09-13T05:44:34.916742+0000 mgr.y (mgr.14152) 64 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:37.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[31923]: audit 2024-09-13T05:44:36.211394+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:37.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[31923]: audit 2024-09-13T05:44:36.211394+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:37.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[31923]: audit 2024-09-13T05:44:36.218575+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:37.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[31923]: audit 2024-09-13T05:44:36.218575+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:37.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[31923]: audit 2024-09-13T05:44:36.220500+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:37.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[31923]: audit 2024-09-13T05:44:36.220500+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:37.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[31923]: audit 2024-09-13T05:44:36.221640+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:37.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[31923]: audit 2024-09-13T05:44:36.221640+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:37.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[31923]: audit 2024-09-13T05:44:36.222741+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:37.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[31923]: audit 2024-09-13T05:44:36.222741+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:37.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[22814]: cluster 2024-09-13T05:44:34.916742+0000 mgr.y (mgr.14152) 64 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:37.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[22814]: cluster 2024-09-13T05:44:34.916742+0000 mgr.y (mgr.14152) 64 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:37.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[22814]: audit 2024-09-13T05:44:36.211394+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:37.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[22814]: audit 2024-09-13T05:44:36.211394+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:37.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[22814]: audit 2024-09-13T05:44:36.218575+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:37.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[22814]: audit 2024-09-13T05:44:36.218575+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:37.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[22814]: audit 2024-09-13T05:44:36.220500+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:37.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[22814]: audit 2024-09-13T05:44:36.220500+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:37.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[22814]: audit 2024-09-13T05:44:36.221640+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:37.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[22814]: audit 2024-09-13T05:44:36.221640+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:37.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[22814]: audit 2024-09-13T05:44:36.222741+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:37.241 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:36 smithi079 bash[22814]: audit 2024-09-13T05:44:36.222741+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:37.371 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:36 smithi139 bash[24829]: cluster 2024-09-13T05:44:34.916742+0000 mgr.y (mgr.14152) 64 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:37.371 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:36 smithi139 bash[24829]: cluster 2024-09-13T05:44:34.916742+0000 mgr.y (mgr.14152) 64 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:37.371 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:36 smithi139 bash[24829]: audit 2024-09-13T05:44:36.211394+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:37.371 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:36 smithi139 bash[24829]: audit 2024-09-13T05:44:36.211394+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:37.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:36 smithi139 bash[24829]: audit 2024-09-13T05:44:36.218575+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:37.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:36 smithi139 bash[24829]: audit 2024-09-13T05:44:36.218575+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:37.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:36 smithi139 bash[24829]: audit 2024-09-13T05:44:36.220500+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:37.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:36 smithi139 bash[24829]: audit 2024-09-13T05:44:36.220500+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:37.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:36 smithi139 bash[24829]: audit 2024-09-13T05:44:36.221640+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:37.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:36 smithi139 bash[24829]: audit 2024-09-13T05:44:36.221640+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:37.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:36 smithi139 bash[24829]: audit 2024-09-13T05:44:36.222741+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:37.372 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:36 smithi139 bash[24829]: audit 2024-09-13T05:44:36.222741+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:38.105 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:37 smithi079 bash[31923]: cephadm 2024-09-13T05:44:36.220063+0000 mgr.y (mgr.14152) 65 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-13T05:44:38.106 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:37 smithi079 bash[31923]: cephadm 2024-09-13T05:44:36.220063+0000 mgr.y (mgr.14152) 65 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-13T05:44:38.106 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:37 smithi079 bash[31923]: cephadm 2024-09-13T05:44:36.224222+0000 mgr.y (mgr.14152) 66 : cephadm [INF] Reconfiguring daemon mon.c on smithi079 2024-09-13T05:44:38.106 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:37 smithi079 bash[31923]: cephadm 2024-09-13T05:44:36.224222+0000 mgr.y (mgr.14152) 66 : cephadm [INF] Reconfiguring daemon mon.c on smithi079 2024-09-13T05:44:38.106 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:37 smithi079 bash[22814]: cephadm 2024-09-13T05:44:36.220063+0000 mgr.y (mgr.14152) 65 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-13T05:44:38.106 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:37 smithi079 bash[22814]: cephadm 2024-09-13T05:44:36.220063+0000 mgr.y (mgr.14152) 65 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-13T05:44:38.106 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:37 smithi079 bash[22814]: cephadm 2024-09-13T05:44:36.224222+0000 mgr.y (mgr.14152) 66 : cephadm [INF] Reconfiguring daemon mon.c on smithi079 2024-09-13T05:44:38.106 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:37 smithi079 bash[22814]: cephadm 2024-09-13T05:44:36.224222+0000 mgr.y (mgr.14152) 66 : cephadm [INF] Reconfiguring daemon mon.c on smithi079 2024-09-13T05:44:38.371 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:37 smithi139 bash[24829]: cephadm 2024-09-13T05:44:36.220063+0000 mgr.y (mgr.14152) 65 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-13T05:44:38.371 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:37 smithi139 bash[24829]: cephadm 2024-09-13T05:44:36.220063+0000 mgr.y (mgr.14152) 65 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-13T05:44:38.371 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:37 smithi139 bash[24829]: cephadm 2024-09-13T05:44:36.224222+0000 mgr.y (mgr.14152) 66 : cephadm [INF] Reconfiguring daemon mon.c on smithi079 2024-09-13T05:44:38.371 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:37 smithi139 bash[24829]: cephadm 2024-09-13T05:44:36.224222+0000 mgr.y (mgr.14152) 66 : cephadm [INF] Reconfiguring daemon mon.c on smithi079 2024-09-13T05:44:39.155 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T05:44:39.206 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:38 smithi139 bash[24829]: cluster 2024-09-13T05:44:36.917111+0000 mgr.y (mgr.14152) 67 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:39.206 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:38 smithi139 bash[24829]: cluster 2024-09-13T05:44:36.917111+0000 mgr.y (mgr.14152) 67 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:39.206 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:38 smithi139 bash[24829]: audit 2024-09-13T05:44:38.535688+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:39.206 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:38 smithi139 bash[24829]: audit 2024-09-13T05:44:38.535688+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:39.206 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:38 smithi139 bash[24829]: audit 2024-09-13T05:44:38.542694+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:39.206 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:38 smithi139 bash[24829]: audit 2024-09-13T05:44:38.542694+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:39.206 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:38 smithi139 bash[24829]: audit 2024-09-13T05:44:38.544685+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:39.206 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:38 smithi139 bash[24829]: audit 2024-09-13T05:44:38.544685+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:39.206 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:38 smithi139 bash[24829]: audit 2024-09-13T05:44:38.546179+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:39.206 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:38 smithi139 bash[24829]: audit 2024-09-13T05:44:38.546179+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:39.206 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:38 smithi139 bash[24829]: audit 2024-09-13T05:44:38.547490+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:39.207 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:38 smithi139 bash[24829]: audit 2024-09-13T05:44:38.547490+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:39.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[22814]: cluster 2024-09-13T05:44:36.917111+0000 mgr.y (mgr.14152) 67 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:39.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[22814]: cluster 2024-09-13T05:44:36.917111+0000 mgr.y (mgr.14152) 67 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:39.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[22814]: audit 2024-09-13T05:44:38.535688+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:39.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[22814]: audit 2024-09-13T05:44:38.535688+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:39.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[22814]: audit 2024-09-13T05:44:38.542694+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:39.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[22814]: audit 2024-09-13T05:44:38.542694+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:39.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[22814]: audit 2024-09-13T05:44:38.544685+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:39.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[22814]: audit 2024-09-13T05:44:38.544685+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:39.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[22814]: audit 2024-09-13T05:44:38.546179+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:39.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[22814]: audit 2024-09-13T05:44:38.546179+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:39.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[22814]: audit 2024-09-13T05:44:38.547490+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:39.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[22814]: audit 2024-09-13T05:44:38.547490+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:39.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[31923]: cluster 2024-09-13T05:44:36.917111+0000 mgr.y (mgr.14152) 67 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:39.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[31923]: cluster 2024-09-13T05:44:36.917111+0000 mgr.y (mgr.14152) 67 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:39.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[31923]: audit 2024-09-13T05:44:38.535688+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:39.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[31923]: audit 2024-09-13T05:44:38.535688+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:39.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[31923]: audit 2024-09-13T05:44:38.542694+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:39.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[31923]: audit 2024-09-13T05:44:38.542694+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:39.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[31923]: audit 2024-09-13T05:44:38.544685+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:39.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[31923]: audit 2024-09-13T05:44:38.544685+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-13T05:44:39.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[31923]: audit 2024-09-13T05:44:38.546179+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:39.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[31923]: audit 2024-09-13T05:44:38.546179+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-13T05:44:39.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[31923]: audit 2024-09-13T05:44:38.547490+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:39.240 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:38 smithi079 bash[31923]: audit 2024-09-13T05:44:38.547490+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:39 smithi079 bash[22814]: cephadm 2024-09-13T05:44:38.544197+0000 mgr.y (mgr.14152) 68 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-13T05:44:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:39 smithi079 bash[22814]: cephadm 2024-09-13T05:44:38.544197+0000 mgr.y (mgr.14152) 68 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-13T05:44:40.238 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:39 smithi079 bash[22814]: cephadm 2024-09-13T05:44:38.549128+0000 mgr.y (mgr.14152) 69 : cephadm [INF] Reconfiguring daemon mon.b on smithi139 2024-09-13T05:44:40.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:39 smithi079 bash[22814]: cephadm 2024-09-13T05:44:38.549128+0000 mgr.y (mgr.14152) 69 : cephadm [INF] Reconfiguring daemon mon.b on smithi139 2024-09-13T05:44:40.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:39 smithi079 bash[31923]: cephadm 2024-09-13T05:44:38.544197+0000 mgr.y (mgr.14152) 68 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-13T05:44:40.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:39 smithi079 bash[31923]: cephadm 2024-09-13T05:44:38.544197+0000 mgr.y (mgr.14152) 68 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-13T05:44:40.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:39 smithi079 bash[31923]: cephadm 2024-09-13T05:44:38.549128+0000 mgr.y (mgr.14152) 69 : cephadm [INF] Reconfiguring daemon mon.b on smithi139 2024-09-13T05:44:40.239 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:39 smithi079 bash[31923]: cephadm 2024-09-13T05:44:38.549128+0000 mgr.y (mgr.14152) 69 : cephadm [INF] Reconfiguring daemon mon.b on smithi139 2024-09-13T05:44:40.294 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:39 smithi139 bash[24829]: cephadm 2024-09-13T05:44:38.544197+0000 mgr.y (mgr.14152) 68 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-13T05:44:40.294 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:39 smithi139 bash[24829]: cephadm 2024-09-13T05:44:38.544197+0000 mgr.y (mgr.14152) 68 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-13T05:44:40.294 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:39 smithi139 bash[24829]: cephadm 2024-09-13T05:44:38.549128+0000 mgr.y (mgr.14152) 69 : cephadm [INF] Reconfiguring daemon mon.b on smithi139 2024-09-13T05:44:40.294 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:39 smithi139 bash[24829]: cephadm 2024-09-13T05:44:38.549128+0000 mgr.y (mgr.14152) 69 : cephadm [INF] Reconfiguring daemon mon.b on smithi139 2024-09-13T05:44:40.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 -- 172.21.15.79:0/3337329953 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c20104fd0 msgr2=0x7f8c201053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:40.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 --2- 172.21.15.79:0/3337329953 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c20104fd0 0x7f8c201053b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8c08009900 tx=0x7f8c0802a410 comp rx=0 tx=0).stop 2024-09-13T05:44:40.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 -- 172.21.15.79:0/3337329953 shutdown_connections 2024-09-13T05:44:40.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 --2- 172.21.15.79:0/3337329953 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c2010b360 0x7f8c20111b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:40.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 --2- 172.21.15.79:0/3337329953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c2010a9e0 0x7f8c2010ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:40.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 --2- 172.21.15.79:0/3337329953 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c20104fd0 0x7f8c201053b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:40.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 -- 172.21.15.79:0/3337329953 >> 172.21.15.79:0/3337329953 conn(0x7f8c20100a20 msgr2=0x7f8c20102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:40.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 -- 172.21.15.79:0/3337329953 shutdown_connections 2024-09-13T05:44:40.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 -- 172.21.15.79:0/3337329953 wait complete. 2024-09-13T05:44:40.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 Processor -- start 2024-09-13T05:44:40.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 -- start start 2024-09-13T05:44:40.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c20104fd0 0x7f8c2019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:40.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c2010a9e0 0x7f8c2019b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:40.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c2010b360 0x7f8c201a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:40.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8c20114780 con 0x7f8c2010b360 2024-09-13T05:44:40.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8c20114600 con 0x7f8c2010a9e0 2024-09-13T05:44:40.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c26664640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f8c20114900 con 0x7f8c20104fd0 2024-09-13T05:44:40.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c1ffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c20104fd0 0x7f8c2019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:40.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c1ffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c20104fd0 0x7f8c2019ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:34788/0 (socket says 172.21.15.79:34788) 2024-09-13T05:44:40.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c1ffff640 1 -- 172.21.15.79:0/2287117713 learned_addr learned my addr 172.21.15.79:0/2287117713 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-13T05:44:40.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c24c01640 1 --2- 172.21.15.79:0/2287117713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c2010b360 0x7f8c201a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:40.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c1f7fe640 1 --2- 172.21.15.79:0/2287117713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c2010a9e0 0x7f8c2019b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:40.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c1ffff640 1 -- 172.21.15.79:0/2287117713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c2010a9e0 msgr2=0x7f8c2019b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:40.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c1ffff640 1 --2- 172.21.15.79:0/2287117713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c2010a9e0 0x7f8c2019b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:40.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c1ffff640 1 -- 172.21.15.79:0/2287117713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c2010b360 msgr2=0x7f8c201a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:40.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c1ffff640 1 --2- 172.21.15.79:0/2287117713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c2010b360 0x7f8c201a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:40.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c1ffff640 1 -- 172.21.15.79:0/2287117713 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c201a0d00 con 0x7f8c20104fd0 2024-09-13T05:44:40.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c1f7fe640 1 --2- 172.21.15.79:0/2287117713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c2010a9e0 0x7f8c2019b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T05:44:40.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.373+0000 7f8c1ffff640 1 --2- 172.21.15.79:0/2287117713 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c20104fd0 0x7f8c2019ac50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8c08005ab0 tx=0x7f8c08005080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:40.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.377+0000 7f8c1d7fa640 1 -- 172.21.15.79:0/2287117713 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0803f070 con 0x7f8c20104fd0 2024-09-13T05:44:40.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.377+0000 7f8c1d7fa640 1 -- 172.21.15.79:0/2287117713 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7f8c08003a70 con 0x7f8c20104fd0 2024-09-13T05:44:40.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.377+0000 7f8c26664640 1 -- 172.21.15.79:0/2287117713 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c201a0f90 con 0x7f8c20104fd0 2024-09-13T05:44:40.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.377+0000 7f8c1d7fa640 1 -- 172.21.15.79:0/2287117713 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c08035030 con 0x7f8c20104fd0 2024-09-13T05:44:40.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.377+0000 7f8c26664640 1 -- 172.21.15.79:0/2287117713 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c201a76b0 con 0x7f8c20104fd0 2024-09-13T05:44:40.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.377+0000 7f8c1d7fa640 1 -- 172.21.15.79:0/2287117713 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 14) ==== 51786+0+0 (secure 0 0 0) 0x7f8c08042070 con 0x7f8c20104fd0 2024-09-13T05:44:40.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.377+0000 7f8c26664640 1 -- 172.21.15.79:0/2287117713 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c201053b0 con 0x7f8c20104fd0 2024-09-13T05:44:40.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.377+0000 7f8c1d7fa640 1 --2- 172.21.15.79:0/2287117713 >> v2:172.21.15.79:6800/614049769 conn(0x7f8c0c03f940 0x7f8c0c041e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:40.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.377+0000 7f8c1d7fa640 1 -- 172.21.15.79:0/2287117713 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f8c08074b60 con 0x7f8c20104fd0 2024-09-13T05:44:40.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.377+0000 7f8c1f7fe640 1 --2- 172.21.15.79:0/2287117713 >> v2:172.21.15.79:6800/614049769 conn(0x7f8c0c03f940 0x7f8c0c041e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:40.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.377+0000 7f8c1f7fe640 1 --2- 172.21.15.79:0/2287117713 >> v2:172.21.15.79:6800/614049769 conn(0x7f8c0c03f940 0x7f8c0c041e00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8c2010a510 tx=0x7f8c10005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:40.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.381+0000 7f8c1d7fa640 1 -- 172.21.15.79:0/2287117713 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7f8c08031dd0 con 0x7f8c20104fd0 2024-09-13T05:44:40.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.573+0000 7f8c26664640 1 -- 172.21.15.79:0/2287117713 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f8c2010d140 con 0x7f8c20104fd0 2024-09-13T05:44:40.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.573+0000 7f8c1d7fa640 1 -- 172.21.15.79:0/2287117713 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f8c08037d90 con 0x7f8c20104fd0 2024-09-13T05:44:40.576 INFO:teuthology.orchestra.run.smithi079.stdout:# minimal ceph.conf for bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:40.576 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-09-13T05:44:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:44:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: mon_host = [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] 2024-09-13T05:44:40.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.573+0000 7f8c26664640 1 -- 172.21.15.79:0/2287117713 >> v2:172.21.15.79:6800/614049769 conn(0x7f8c0c03f940 msgr2=0x7f8c0c041e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:40.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.573+0000 7f8c26664640 1 --2- 172.21.15.79:0/2287117713 >> v2:172.21.15.79:6800/614049769 conn(0x7f8c0c03f940 0x7f8c0c041e00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8c2010a510 tx=0x7f8c10005f90 comp rx=0 tx=0).stop 2024-09-13T05:44:40.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.573+0000 7f8c26664640 1 -- 172.21.15.79:0/2287117713 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c20104fd0 msgr2=0x7f8c2019ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:40.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.573+0000 7f8c26664640 1 --2- 172.21.15.79:0/2287117713 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c20104fd0 0x7f8c2019ac50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8c08005ab0 tx=0x7f8c08005080 comp rx=0 tx=0).stop 2024-09-13T05:44:40.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.577+0000 7f8c26664640 1 -- 172.21.15.79:0/2287117713 shutdown_connections 2024-09-13T05:44:40.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.577+0000 7f8c26664640 1 --2- 172.21.15.79:0/2287117713 >> v2:172.21.15.79:6800/614049769 conn(0x7f8c0c03f940 0x7f8c0c041e00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:40.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.577+0000 7f8c26664640 1 --2- 172.21.15.79:0/2287117713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c2010b360 0x7f8c201a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:40.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.577+0000 7f8c26664640 1 --2- 172.21.15.79:0/2287117713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c2010a9e0 0x7f8c2019b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:40.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.577+0000 7f8c26664640 1 --2- 172.21.15.79:0/2287117713 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c20104fd0 0x7f8c2019ac50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:40.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.577+0000 7f8c26664640 1 -- 172.21.15.79:0/2287117713 >> 172.21.15.79:0/2287117713 conn(0x7f8c20100a20 msgr2=0x7f8c20102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:40.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.577+0000 7f8c26664640 1 -- 172.21.15.79:0/2287117713 shutdown_connections 2024-09-13T05:44:40.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-13T05:44:40.577+0000 7f8c26664640 1 -- 172.21.15.79:0/2287117713 wait complete. 2024-09-13T05:44:41.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: cluster 2024-09-13T05:44:38.917527+0000 mgr.y (mgr.14152) 70 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:41.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: cluster 2024-09-13T05:44:38.917527+0000 mgr.y (mgr.14152) 70 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:41.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: audit 2024-09-13T05:44:40.576121+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.79:0/2287117713' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:41.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: audit 2024-09-13T05:44:40.576121+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.79:0/2287117713' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:41.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: audit 2024-09-13T05:44:40.634039+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: audit 2024-09-13T05:44:40.634039+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: audit 2024-09-13T05:44:40.638264+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: audit 2024-09-13T05:44:40.638264+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: audit 2024-09-13T05:44:40.639222+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:41.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: audit 2024-09-13T05:44:40.639222+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:41.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: audit 2024-09-13T05:44:40.640634+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:41.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: audit 2024-09-13T05:44:40.640634+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:41.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: audit 2024-09-13T05:44:40.641266+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:41.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: audit 2024-09-13T05:44:40.641266+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:41.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: audit 2024-09-13T05:44:40.645379+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.240 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[22814]: audit 2024-09-13T05:44:40.645379+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: cluster 2024-09-13T05:44:38.917527+0000 mgr.y (mgr.14152) 70 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:41.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: cluster 2024-09-13T05:44:38.917527+0000 mgr.y (mgr.14152) 70 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:41.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: audit 2024-09-13T05:44:40.576121+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.79:0/2287117713' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:41.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: audit 2024-09-13T05:44:40.576121+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.79:0/2287117713' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:41.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: audit 2024-09-13T05:44:40.634039+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: audit 2024-09-13T05:44:40.634039+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: audit 2024-09-13T05:44:40.638264+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: audit 2024-09-13T05:44:40.638264+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: audit 2024-09-13T05:44:40.639222+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:41.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: audit 2024-09-13T05:44:40.639222+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:41.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: audit 2024-09-13T05:44:40.640634+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:41.241 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: audit 2024-09-13T05:44:40.640634+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:41.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: audit 2024-09-13T05:44:40.641266+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:41.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: audit 2024-09-13T05:44:40.641266+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:41.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: audit 2024-09-13T05:44:40.645379+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.242 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:40 smithi079 bash[31923]: audit 2024-09-13T05:44:40.645379+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.287 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T05:44:41.287 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:44:41.287 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T05:44:41.301 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:44:41.301 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:44:41.354 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T05:44:41.354 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T05:44:41.366 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: cluster 2024-09-13T05:44:38.917527+0000 mgr.y (mgr.14152) 70 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:41.366 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: cluster 2024-09-13T05:44:38.917527+0000 mgr.y (mgr.14152) 70 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:41.366 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: audit 2024-09-13T05:44:40.576121+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.79:0/2287117713' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:41.366 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: audit 2024-09-13T05:44:40.576121+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.79:0/2287117713' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:41.366 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: audit 2024-09-13T05:44:40.634039+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.366 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: audit 2024-09-13T05:44:40.634039+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.366 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: audit 2024-09-13T05:44:40.638264+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.367 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: audit 2024-09-13T05:44:40.638264+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.367 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: audit 2024-09-13T05:44:40.639222+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:41.367 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: audit 2024-09-13T05:44:40.639222+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:41.367 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: audit 2024-09-13T05:44:40.640634+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:41.367 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: audit 2024-09-13T05:44:40.640634+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:41.367 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: audit 2024-09-13T05:44:40.641266+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:41.367 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: audit 2024-09-13T05:44:40.641266+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:41.367 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: audit 2024-09-13T05:44:40.645379+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.367 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:40 smithi139 bash[24829]: audit 2024-09-13T05:44:40.645379+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:41.369 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T05:44:41.369 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T05:44:41.422 INFO:tasks.cephadm:Adding mgr.y on smithi079 2024-09-13T05:44:41.422 INFO:tasks.cephadm:Adding mgr.x on smithi139 2024-09-13T05:44:41.422 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- ceph orch apply mgr '2;smithi079=y;smithi139=x' 2024-09-13T05:44:42.988 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:42 smithi079 bash[31923]: cluster 2024-09-13T05:44:40.917979+0000 mgr.y (mgr.14152) 71 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:42.988 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:42 smithi079 bash[31923]: cluster 2024-09-13T05:44:40.917979+0000 mgr.y (mgr.14152) 71 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:42.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:42 smithi079 bash[22814]: cluster 2024-09-13T05:44:40.917979+0000 mgr.y (mgr.14152) 71 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:42.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:42 smithi079 bash[22814]: cluster 2024-09-13T05:44:40.917979+0000 mgr.y (mgr.14152) 71 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:43.121 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:42 smithi139 bash[24829]: cluster 2024-09-13T05:44:40.917979+0000 mgr.y (mgr.14152) 71 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:43.121 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:42 smithi139 bash[24829]: cluster 2024-09-13T05:44:40.917979+0000 mgr.y (mgr.14152) 71 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:44.988 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:44 smithi079 bash[31923]: cluster 2024-09-13T05:44:42.918423+0000 mgr.y (mgr.14152) 72 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:44.988 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:44 smithi079 bash[31923]: cluster 2024-09-13T05:44:42.918423+0000 mgr.y (mgr.14152) 72 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:44.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:44 smithi079 bash[22814]: cluster 2024-09-13T05:44:42.918423+0000 mgr.y (mgr.14152) 72 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:44.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:44 smithi079 bash[22814]: cluster 2024-09-13T05:44:42.918423+0000 mgr.y (mgr.14152) 72 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:45.121 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:44 smithi139 bash[24829]: cluster 2024-09-13T05:44:42.918423+0000 mgr.y (mgr.14152) 72 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:45.121 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:44 smithi139 bash[24829]: cluster 2024-09-13T05:44:42.918423+0000 mgr.y (mgr.14152) 72 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:45.186 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T05:44:46.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 -- 172.21.15.139:0/3846290342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8a0108760 msgr2=0x7fd8a010ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:46.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 --2- 172.21.15.139:0/3846290342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8a0108760 0x7fd8a010ac20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd898009ca0 tx=0x7fd89802a8c0 comp rx=0 tx=0).stop 2024-09-13T05:44:46.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 -- 172.21.15.139:0/3846290342 shutdown_connections 2024-09-13T05:44:46.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 --2- 172.21.15.139:0/3846290342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8a0108760 0x7fd8a010ac20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:46.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 --2- 172.21.15.139:0/3846290342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a0105bb0 0x7fd8a0108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:46.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 --2- 172.21.15.139:0/3846290342 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8a006c360 0x7fd8a0105670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:46.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 -- 172.21.15.139:0/3846290342 >> 172.21.15.139:0/3846290342 conn(0x7fd8a00fd240 msgr2=0x7fd8a00ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:46.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 -- 172.21.15.139:0/3846290342 shutdown_connections 2024-09-13T05:44:46.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 -- 172.21.15.139:0/3846290342 wait complete. 2024-09-13T05:44:46.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 Processor -- start 2024-09-13T05:44:46.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 -- start start 2024-09-13T05:44:46.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8a006c360 0x7fd8a0198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:46.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8a0105bb0 0x7fd8a0198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:46.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a0108760 0x7fd8a01997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:46.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a010ddd0 con 0x7fd8a0108760 2024-09-13T05:44:46.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a010dc50 con 0x7fd8a0105bb0 2024-09-13T05:44:46.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a010df50 con 0x7fd8a006c360 2024-09-13T05:44:46.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a5649640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8a0105bb0 0x7fd8a0198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:46.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a5649640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8a0105bb0 0x7fd8a0198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57702/0 (socket says 172.21.15.139:57702) 2024-09-13T05:44:46.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a5649640 1 -- 172.21.15.139:0/1837684611 learned_addr learned my addr 172.21.15.139:0/1837684611 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-13T05:44:46.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a5e4a640 1 --2- 172.21.15.139:0/1837684611 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8a006c360 0x7fd8a0198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:46.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a664b640 1 --2- 172.21.15.139:0/1837684611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a0108760 0x7fd8a01997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:46.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a5649640 1 -- 172.21.15.139:0/1837684611 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8a006c360 msgr2=0x7fd8a0198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:46.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a5649640 1 --2- 172.21.15.139:0/1837684611 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8a006c360 0x7fd8a0198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:46.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a5649640 1 -- 172.21.15.139:0/1837684611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a0108760 msgr2=0x7fd8a01997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:46.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a5649640 1 --2- 172.21.15.139:0/1837684611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a0108760 0x7fd8a01997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:46.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a5649640 1 -- 172.21.15.139:0/1837684611 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a019a070 con 0x7fd8a0105bb0 2024-09-13T05:44:46.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a5649640 1 --2- 172.21.15.139:0/1837684611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8a0105bb0 0x7fd8a0198b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd89000d950 tx=0x7fd89000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:46.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd896ffd640 1 -- 172.21.15.139:0/1837684611 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd890017070 con 0x7fd8a0105bb0 2024-09-13T05:44:46.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd896ffd640 1 -- 172.21.15.139:0/1837684611 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) ==== 1054+0+0 (secure 0 0 0) 0x7fd890009c30 con 0x7fd8a0105bb0 2024-09-13T05:44:46.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 -- 172.21.15.139:0/1837684611 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a019a360 con 0x7fd8a0105bb0 2024-09-13T05:44:46.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd896ffd640 1 -- 172.21.15.139:0/1837684611 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89000f620 con 0x7fd8a0105bb0 2024-09-13T05:44:46.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.288+0000 7fd8a80ae640 1 -- 172.21.15.139:0/1837684611 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a01a0a40 con 0x7fd8a0105bb0 2024-09-13T05:44:46.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.292+0000 7fd896ffd640 1 -- 172.21.15.139:0/1837684611 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 14) ==== 51786+0+0 (secure 0 0 0) 0x7fd890010460 con 0x7fd8a0105bb0 2024-09-13T05:44:46.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.292+0000 7fd8a80ae640 1 -- 172.21.15.139:0/1837684611 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a0106010 con 0x7fd8a0105bb0 2024-09-13T05:44:46.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.292+0000 7fd896ffd640 1 --2- 172.21.15.139:0/1837684611 >> v2:172.21.15.79:6800/614049769 conn(0x7fd88c03f940 0x7fd88c041e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T05:44:46.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.292+0000 7fd896ffd640 1 -- 172.21.15.139:0/1837684611 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7fd890053f90 con 0x7fd8a0105bb0 2024-09-13T05:44:46.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.292+0000 7fd8a5e4a640 1 --2- 172.21.15.139:0/1837684611 >> v2:172.21.15.79:6800/614049769 conn(0x7fd88c03f940 0x7fd88c041e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T05:44:46.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.292+0000 7fd8a5e4a640 1 --2- 172.21.15.139:0/1837684611 >> v2:172.21.15.79:6800/614049769 conn(0x7fd88c03f940 0x7fd88c041e00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd89c005fd0 tx=0x7fd89c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T05:44:46.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.296+0000 7fd896ffd640 1 -- 172.21.15.139:0/1837684611 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196987 (secure 0 0 0) 0x7fd89000fce0 con 0x7fd8a0105bb0 2024-09-13T05:44:46.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.492+0000 7fd8a80ae640 1 -- 172.21.15.139:0/1837684611 --> v2:172.21.15.79:6800/614049769 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi079=y;smithi139=x", "target": ["mon-mgr", ""]}) -- 0x7fd8a0063590 con 0x7fd88c03f940 2024-09-13T05:44:46.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.504+0000 7fd896ffd640 1 -- 172.21.15.139:0/1837684611 <== mgr.14152 v2:172.21.15.79:6800/614049769 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd8a0063590 con 0x7fd88c03f940 2024-09-13T05:44:46.507 INFO:teuthology.orchestra.run.smithi139.stdout:Scheduled mgr update... 2024-09-13T05:44:46.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.508+0000 7fd8a80ae640 1 -- 172.21.15.139:0/1837684611 >> v2:172.21.15.79:6800/614049769 conn(0x7fd88c03f940 msgr2=0x7fd88c041e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:46.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.508+0000 7fd8a80ae640 1 --2- 172.21.15.139:0/1837684611 >> v2:172.21.15.79:6800/614049769 conn(0x7fd88c03f940 0x7fd88c041e00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd89c005fd0 tx=0x7fd89c005850 comp rx=0 tx=0).stop 2024-09-13T05:44:46.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.508+0000 7fd8a80ae640 1 -- 172.21.15.139:0/1837684611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8a0105bb0 msgr2=0x7fd8a0198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T05:44:46.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.508+0000 7fd8a80ae640 1 --2- 172.21.15.139:0/1837684611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8a0105bb0 0x7fd8a0198b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd89000d950 tx=0x7fd89000de10 comp rx=0 tx=0).stop 2024-09-13T05:44:46.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.508+0000 7fd8a80ae640 1 -- 172.21.15.139:0/1837684611 shutdown_connections 2024-09-13T05:44:46.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.508+0000 7fd8a80ae640 1 --2- 172.21.15.139:0/1837684611 >> v2:172.21.15.79:6800/614049769 conn(0x7fd88c03f940 0x7fd88c041e00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:46.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.508+0000 7fd8a80ae640 1 --2- 172.21.15.139:0/1837684611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8a0108760 0x7fd8a01997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:46.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.508+0000 7fd8a80ae640 1 --2- 172.21.15.139:0/1837684611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8a0105bb0 0x7fd8a0198b90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:46.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.508+0000 7fd8a80ae640 1 --2- 172.21.15.139:0/1837684611 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd8a006c360 0x7fd8a0198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T05:44:46.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.508+0000 7fd8a80ae640 1 -- 172.21.15.139:0/1837684611 >> 172.21.15.139:0/1837684611 conn(0x7fd8a00fd240 msgr2=0x7fd8a0103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T05:44:46.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.508+0000 7fd8a80ae640 1 -- 172.21.15.139:0/1837684611 shutdown_connections 2024-09-13T05:44:46.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T05:44:46.508+0000 7fd8a80ae640 1 -- 172.21.15.139:0/1837684611 wait complete. 2024-09-13T05:44:46.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: cluster 2024-09-13T05:44:44.918823+0000 mgr.y (mgr.14152) 73 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:46.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: cluster 2024-09-13T05:44:44.918823+0000 mgr.y (mgr.14152) 73 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:46.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.506584+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:46.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.506584+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:46.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.508405+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:46.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.508405+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:46.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.511778+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:46.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.511778+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:46.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.513588+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:46.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.513588+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:46.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.522619+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:46.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.522619+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:46.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.525924+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-13T05:44:46.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.525924+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-13T05:44:46.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.528589+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T05:44:46.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.528589+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T05:44:46.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.533565+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-13T05:44:46.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.533565+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-13T05:44:46.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.535349+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:46.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:46 smithi139 bash[24829]: audit 2024-09-13T05:44:46.535349+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:46.989 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: cluster 2024-09-13T05:44:44.918823+0000 mgr.y (mgr.14152) 73 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:46.989 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: cluster 2024-09-13T05:44:44.918823+0000 mgr.y (mgr.14152) 73 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:46.989 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.506584+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:46.989 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.506584+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:46.989 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.508405+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:46.989 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.508405+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:46.989 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.511778+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:46.989 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.511778+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:46.989 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.513588+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:46.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.513588+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:46.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.522619+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:46.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.522619+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:46.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.525924+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-13T05:44:46.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.525924+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-13T05:44:46.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.528589+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T05:44:46.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.528589+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T05:44:46.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.533565+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-13T05:44:46.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.533565+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-13T05:44:46.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: cluster 2024-09-13T05:44:44.918823+0000 mgr.y (mgr.14152) 73 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:46.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: cluster 2024-09-13T05:44:44.918823+0000 mgr.y (mgr.14152) 73 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:46.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.506584+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:46.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.506584+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:46.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.508405+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:46.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.508405+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:46.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.511778+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:46.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.511778+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:46.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.513588+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:46.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.513588+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:46.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.522619+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:46.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.522619+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:46.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.525924+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-13T05:44:46.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.525924+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-13T05:44:46.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.528589+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T05:44:46.992 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.528589+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T05:44:46.992 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.533565+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-13T05:44:46.992 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.533565+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-13T05:44:46.992 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.535349+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:46.992 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[22814]: audit 2024-09-13T05:44:46.535349+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:46.992 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.535349+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:46.992 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:46 smithi079 bash[31923]: audit 2024-09-13T05:44:46.535349+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:47.001 DEBUG:teuthology.orchestra.run.smithi139:mgr.x> sudo journalctl -f -n 0 -u ceph-bf551932-7192-11ef-bceb-c7b262605968@mgr.x.service 2024-09-13T05:44:47.003 DEBUG:tasks.cephadm:set 0 configs 2024-09-13T05:44:47.003 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T05:44:47.004 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-13T05:44:47.004 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T05:44:47.010 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T05:44:47.010 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-09-13T05:44:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T05:44:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:44:47.059 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-09-13T05:44:47.059 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:44:47.059 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-13 05:35:28.422687554 +0000 2024-09-13T05:44:47.060 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-13 05:35:28.186689661 +0000 2024-09-13T05:44:47.060 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-13 05:35:28.186689661 +0000 2024-09-13T05:44:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-13T05:44:47.060 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T05:44:47.113 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-13T05:44:47.113 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-13T05:44:47.113 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000338667 s, 1.5 MB/s 2024-09-13T05:44:47.114 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T05:44:47.164 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-09-13T05:44:47.214 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T05:44:47.214 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:44:47.214 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-09-13T05:44:47.215 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:44:47.215 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-13 05:35:28.918683124 +0000 2024-09-13T05:44:47.215 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-13 05:35:28.646685553 +0000 2024-09-13T05:44:47.215 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-13 05:35:28.646685553 +0000 2024-09-13T05:44:47.215 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-13T05:44:47.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T05:44:47.269 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-13T05:44:47.269 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-13T05:44:47.269 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000385195 s, 1.3 MB/s 2024-09-13T05:44:47.270 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T05:44:47.320 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-09-13T05:44:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T05:44:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:44:47.367 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-09-13T05:44:47.367 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:44:47.367 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-13 05:35:29.414678694 +0000 2024-09-13T05:44:47.367 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-13 05:35:29.162680944 +0000 2024-09-13T05:44:47.367 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-13 05:35:29.162680944 +0000 2024-09-13T05:44:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-13T05:44:47.367 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T05:44:47.421 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-13T05:44:47.421 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-13T05:44:47.422 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000410994 s, 1.2 MB/s 2024-09-13T05:44:47.423 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T05:44:47.472 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-09-13T05:44:47.518 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T05:44:47.519 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:44:47.519 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-09-13T05:44:47.519 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:44:47.519 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-13 05:35:29.890674441 +0000 2024-09-13T05:44:47.519 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-13 05:35:29.646676621 +0000 2024-09-13T05:44:47.519 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-13 05:35:29.646676621 +0000 2024-09-13T05:44:47.519 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-13T05:44:47.519 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T05:44:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-13T05:44:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-13T05:44:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000389266 s, 1.3 MB/s 2024-09-13T05:44:47.574 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T05:44:47.624 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T05:44:47.624 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T05:44:47.630 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T05:44:47.630 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-09-13T05:44:47.678 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T05:44:47.678 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:44:47.678 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-13T05:44:47.679 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:44:47.679 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 05:35:28.412865316 +0000 2024-09-13T05:44:47.679 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 05:35:28.184867353 +0000 2024-09-13T05:44:47.679 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 05:35:28.184867353 +0000 2024-09-13T05:44:47.679 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-13T05:44:47.679 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T05:44:47.732 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T05:44:47.732 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T05:44:47.733 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000329021 s, 1.6 MB/s 2024-09-13T05:44:47.734 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T05:44:47.738 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:47 smithi079 bash[31923]: audit 2024-09-13T05:44:46.496996+0000 mgr.y (mgr.14152) 74 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi079=y;smithi139=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:47.738 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:47 smithi079 bash[31923]: audit 2024-09-13T05:44:46.496996+0000 mgr.y (mgr.14152) 74 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi079=y;smithi139=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:47.738 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:47 smithi079 bash[31923]: cephadm 2024-09-13T05:44:46.500230+0000 mgr.y (mgr.14152) 75 : cephadm [INF] Saving service mgr spec with placement smithi079=y;smithi139=x;count:2 2024-09-13T05:44:47.738 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:47 smithi079 bash[31923]: cephadm 2024-09-13T05:44:46.500230+0000 mgr.y (mgr.14152) 75 : cephadm [INF] Saving service mgr spec with placement smithi079=y;smithi139=x;count:2 2024-09-13T05:44:47.738 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:47 smithi079 bash[31923]: cephadm 2024-09-13T05:44:46.537242+0000 mgr.y (mgr.14152) 76 : cephadm [INF] Deploying daemon mgr.x on smithi139 2024-09-13T05:44:47.738 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:47 smithi079 bash[31923]: cephadm 2024-09-13T05:44:46.537242+0000 mgr.y (mgr.14152) 76 : cephadm [INF] Deploying daemon mgr.x on smithi139 2024-09-13T05:44:47.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:47 smithi079 bash[22814]: audit 2024-09-13T05:44:46.496996+0000 mgr.y (mgr.14152) 74 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi079=y;smithi139=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:47.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:47 smithi079 bash[22814]: audit 2024-09-13T05:44:46.496996+0000 mgr.y (mgr.14152) 74 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi079=y;smithi139=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:47.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:47 smithi079 bash[22814]: cephadm 2024-09-13T05:44:46.500230+0000 mgr.y (mgr.14152) 75 : cephadm [INF] Saving service mgr spec with placement smithi079=y;smithi139=x;count:2 2024-09-13T05:44:47.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:47 smithi079 bash[22814]: cephadm 2024-09-13T05:44:46.500230+0000 mgr.y (mgr.14152) 75 : cephadm [INF] Saving service mgr spec with placement smithi079=y;smithi139=x;count:2 2024-09-13T05:44:47.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:47 smithi079 bash[22814]: cephadm 2024-09-13T05:44:46.537242+0000 mgr.y (mgr.14152) 76 : cephadm [INF] Deploying daemon mgr.x on smithi139 2024-09-13T05:44:47.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:47 smithi079 bash[22814]: cephadm 2024-09-13T05:44:46.537242+0000 mgr.y (mgr.14152) 76 : cephadm [INF] Deploying daemon mgr.x on smithi139 2024-09-13T05:44:47.783 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-09-13T05:44:47.830 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T05:44:47.830 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:44:47.830 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 907 Links: 1 2024-09-13T05:44:47.830 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:44:47.830 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 05:35:28.860861315 +0000 2024-09-13T05:44:47.830 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 05:35:28.608863565 +0000 2024-09-13T05:44:47.830 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 05:35:28.608863565 +0000 2024-09-13T05:44:47.830 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-13T05:44:47.830 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T05:44:47.887 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T05:44:47.887 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T05:44:47.888 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000339917 s, 1.5 MB/s 2024-09-13T05:44:47.889 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T05:44:47.939 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-09-13T05:44:47.986 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T05:44:47.986 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:44:47.986 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 924 Links: 1 2024-09-13T05:44:47.986 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:44:47.986 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 05:35:29.388856599 +0000 2024-09-13T05:44:47.986 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 05:35:29.128858921 +0000 2024-09-13T05:44:47.986 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 05:35:29.128858921 +0000 2024-09-13T05:44:47.986 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-13T05:44:47.986 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T05:44:48.028 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:47 smithi139 bash[24829]: audit 2024-09-13T05:44:46.496996+0000 mgr.y (mgr.14152) 74 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi079=y;smithi139=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:48.029 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:47 smithi139 bash[24829]: audit 2024-09-13T05:44:46.496996+0000 mgr.y (mgr.14152) 74 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi079=y;smithi139=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T05:44:48.029 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:47 smithi139 bash[24829]: cephadm 2024-09-13T05:44:46.500230+0000 mgr.y (mgr.14152) 75 : cephadm [INF] Saving service mgr spec with placement smithi079=y;smithi139=x;count:2 2024-09-13T05:44:48.029 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:47 smithi139 bash[24829]: cephadm 2024-09-13T05:44:46.500230+0000 mgr.y (mgr.14152) 75 : cephadm [INF] Saving service mgr spec with placement smithi079=y;smithi139=x;count:2 2024-09-13T05:44:48.029 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:47 smithi139 bash[24829]: cephadm 2024-09-13T05:44:46.537242+0000 mgr.y (mgr.14152) 76 : cephadm [INF] Deploying daemon mgr.x on smithi139 2024-09-13T05:44:48.029 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:47 smithi139 bash[24829]: cephadm 2024-09-13T05:44:46.537242+0000 mgr.y (mgr.14152) 76 : cephadm [INF] Deploying daemon mgr.x on smithi139 2024-09-13T05:44:48.038 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T05:44:48.038 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T05:44:48.038 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000334742 s, 1.5 MB/s 2024-09-13T05:44:48.039 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T05:44:48.085 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-09-13T05:44:48.133 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T05:44:48.133 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:44:48.133 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-09-13T05:44:48.133 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:44:48.133 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 05:35:29.876852239 +0000 2024-09-13T05:44:48.133 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 05:35:29.628854454 +0000 2024-09-13T05:44:48.133 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 05:35:29.628854454 +0000 2024-09-13T05:44:48.134 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-13T05:44:48.134 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T05:44:48.189 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T05:44:48.190 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T05:44:48.190 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000205895 s, 2.5 MB/s 2024-09-13T05:44:48.191 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T05:44:48.238 INFO:tasks.cephadm:Deploying osd.0 on smithi079 with /dev/vg_nvme/lv_4... 2024-09-13T05:44:48.238 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T05:44:48.988 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:48 smithi079 bash[22814]: cluster 2024-09-13T05:44:46.919192+0000 mgr.y (mgr.14152) 77 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:48.988 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:48 smithi079 bash[22814]: cluster 2024-09-13T05:44:46.919192+0000 mgr.y (mgr.14152) 77 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:48.989 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:48 smithi079 bash[31923]: cluster 2024-09-13T05:44:46.919192+0000 mgr.y (mgr.14152) 77 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:48.989 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:48 smithi079 bash[31923]: cluster 2024-09-13T05:44:46.919192+0000 mgr.y (mgr.14152) 77 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:48.996 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Sep 13 05:44:48 smithi139 systemd[1]: /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T05:44:48.996 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:48 smithi139 bash[24829]: cluster 2024-09-13T05:44:46.919192+0000 mgr.y (mgr.14152) 77 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:48.996 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:48 smithi139 bash[24829]: cluster 2024-09-13T05:44:46.919192+0000 mgr.y (mgr.14152) 77 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:48.996 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:48 smithi139 systemd[1]: /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T05:44:49.361 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:49 smithi139 systemd[1]: /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T05:44:49.362 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Sep 13 05:44:48 smithi139 systemd[1]: /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T05:44:49.362 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Sep 13 05:44:48 smithi139 systemd[1]: /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T05:44:49.362 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Sep 13 05:44:49 smithi139 systemd[1]: /etc/systemd/system/ceph-bf551932-7192-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T05:44:49.362 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Sep 13 05:44:49 smithi139 systemd[1]: Started Ceph mgr.x for bf551932-7192-11ef-bceb-c7b262605968. 2024-09-13T05:44:50.621 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Sep 13 05:44:50 smithi139 bash[25667]: debug 2024-09-13T05:44:50.288+0000 7fd223911640 1 -- 172.21.15.139:0/1952250379 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5622f2f950e0 con 0x5622f2f97800 2024-09-13T05:44:50.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:50 smithi139 bash[24829]: cluster 2024-09-13T05:44:48.919623+0000 mgr.y (mgr.14152) 78 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:50.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:50 smithi139 bash[24829]: cluster 2024-09-13T05:44:48.919623+0000 mgr.y (mgr.14152) 78 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:50.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:50 smithi139 bash[24829]: audit 2024-09-13T05:44:49.299770+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:50 smithi139 bash[24829]: audit 2024-09-13T05:44:49.299770+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:50 smithi139 bash[24829]: audit 2024-09-13T05:44:49.308544+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:50 smithi139 bash[24829]: audit 2024-09-13T05:44:49.308544+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:50 smithi139 bash[24829]: audit 2024-09-13T05:44:49.317761+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:50 smithi139 bash[24829]: audit 2024-09-13T05:44:49.317761+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:50 smithi139 bash[24829]: audit 2024-09-13T05:44:49.326243+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:50 smithi139 bash[24829]: audit 2024-09-13T05:44:49.326243+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:50 smithi139 bash[24829]: audit 2024-09-13T05:44:49.360282+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:50.622 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:50 smithi139 bash[24829]: audit 2024-09-13T05:44:49.360282+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:50.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[22814]: cluster 2024-09-13T05:44:48.919623+0000 mgr.y (mgr.14152) 78 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:50.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[22814]: cluster 2024-09-13T05:44:48.919623+0000 mgr.y (mgr.14152) 78 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:50.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[22814]: audit 2024-09-13T05:44:49.299770+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[22814]: audit 2024-09-13T05:44:49.299770+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[22814]: audit 2024-09-13T05:44:49.308544+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[22814]: audit 2024-09-13T05:44:49.308544+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[22814]: audit 2024-09-13T05:44:49.317761+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[22814]: audit 2024-09-13T05:44:49.317761+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[22814]: audit 2024-09-13T05:44:49.326243+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[22814]: audit 2024-09-13T05:44:49.326243+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[22814]: audit 2024-09-13T05:44:49.360282+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:50.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[22814]: audit 2024-09-13T05:44:49.360282+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:50.739 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[31923]: cluster 2024-09-13T05:44:48.919623+0000 mgr.y (mgr.14152) 78 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:50.740 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[31923]: cluster 2024-09-13T05:44:48.919623+0000 mgr.y (mgr.14152) 78 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:50.740 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[31923]: audit 2024-09-13T05:44:49.299770+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.740 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[31923]: audit 2024-09-13T05:44:49.299770+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.740 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[31923]: audit 2024-09-13T05:44:49.308544+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.740 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[31923]: audit 2024-09-13T05:44:49.308544+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.740 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[31923]: audit 2024-09-13T05:44:49.317761+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.740 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[31923]: audit 2024-09-13T05:44:49.317761+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.740 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[31923]: audit 2024-09-13T05:44:49.326243+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.740 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[31923]: audit 2024-09-13T05:44:49.326243+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:50.741 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[31923]: audit 2024-09-13T05:44:49.360282+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:50.741 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:50 smithi079 bash[31923]: audit 2024-09-13T05:44:49.360282+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-13T05:44:52.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:52 smithi139 bash[24829]: cluster 2024-09-13T05:44:50.920068+0000 mgr.y (mgr.14152) 79 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:52.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:52 smithi139 bash[24829]: cluster 2024-09-13T05:44:50.920068+0000 mgr.y (mgr.14152) 79 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:52.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:52 smithi139 bash[24829]: audit 2024-09-13T05:44:52.214969+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:52.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:52 smithi139 bash[24829]: audit 2024-09-13T05:44:52.214969+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:52.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:52 smithi079 bash[22814]: cluster 2024-09-13T05:44:50.920068+0000 mgr.y (mgr.14152) 79 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:52.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:52 smithi079 bash[22814]: cluster 2024-09-13T05:44:50.920068+0000 mgr.y (mgr.14152) 79 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:52.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:52 smithi079 bash[22814]: audit 2024-09-13T05:44:52.214969+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:52.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:52 smithi079 bash[22814]: audit 2024-09-13T05:44:52.214969+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:52.739 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:52 smithi079 bash[31923]: cluster 2024-09-13T05:44:50.920068+0000 mgr.y (mgr.14152) 79 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:52.739 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:52 smithi079 bash[31923]: cluster 2024-09-13T05:44:50.920068+0000 mgr.y (mgr.14152) 79 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:52.739 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:52 smithi079 bash[31923]: audit 2024-09-13T05:44:52.214969+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:52.739 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:52 smithi079 bash[31923]: audit 2024-09-13T05:44:52.214969+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:52.978 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T05:44:54.352 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:54 smithi079 bash[31923]: cluster 2024-09-13T05:44:52.920496+0000 mgr.y (mgr.14152) 80 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:54.352 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:54 smithi079 bash[31923]: cluster 2024-09-13T05:44:52.920496+0000 mgr.y (mgr.14152) 80 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:54.353 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:54 smithi079 bash[22814]: cluster 2024-09-13T05:44:52.920496+0000 mgr.y (mgr.14152) 80 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:54.353 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:54 smithi079 bash[22814]: cluster 2024-09-13T05:44:52.920496+0000 mgr.y (mgr.14152) 80 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:54.620 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:54 smithi139 bash[24829]: cluster 2024-09-13T05:44:52.920496+0000 mgr.y (mgr.14152) 80 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:54.621 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:54 smithi139 bash[24829]: cluster 2024-09-13T05:44:52.920496+0000 mgr.y (mgr.14152) 80 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:55.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.593695+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.593695+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.600978+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.600978+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.602671+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:55.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.602671+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:55.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.604417+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:55.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.604417+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:55.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.613600+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.613600+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: cephadm 2024-09-13T05:44:54.648406+0000 mgr.y (mgr.14152) 81 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-13T05:44:55.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: cephadm 2024-09-13T05:44:54.648406+0000 mgr.y (mgr.14152) 81 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-13T05:44:55.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.649150+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-13T05:44:55.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.649150+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-13T05:44:55.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.650927+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-13T05:44:55.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.650927+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-13T05:44:55.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.652324+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:55.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: audit 2024-09-13T05:44:54.652324+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:55.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: cephadm 2024-09-13T05:44:54.654095+0000 mgr.y (mgr.14152) 82 : cephadm [INF] Reconfiguring daemon mgr.y on smithi079 2024-09-13T05:44:55.873 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:55 smithi139 bash[24829]: cephadm 2024-09-13T05:44:54.654095+0000 mgr.y (mgr.14152) 82 : cephadm [INF] Reconfiguring daemon mgr.y on smithi079 2024-09-13T05:44:55.988 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.593695+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.988 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.593695+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.600978+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.600978+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.602671+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:55.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.602671+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:55.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.604417+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:55.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.604417+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:55.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.613600+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.613600+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: cephadm 2024-09-13T05:44:54.648406+0000 mgr.y (mgr.14152) 81 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-13T05:44:55.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: cephadm 2024-09-13T05:44:54.648406+0000 mgr.y (mgr.14152) 81 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-13T05:44:55.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.649150+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-13T05:44:55.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.649150+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-13T05:44:55.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.650927+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-13T05:44:55.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.650927+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-13T05:44:55.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.652324+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:55.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: audit 2024-09-13T05:44:54.652324+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:55.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: cephadm 2024-09-13T05:44:54.654095+0000 mgr.y (mgr.14152) 82 : cephadm [INF] Reconfiguring daemon mgr.y on smithi079 2024-09-13T05:44:55.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[22814]: cephadm 2024-09-13T05:44:54.654095+0000 mgr.y (mgr.14152) 82 : cephadm [INF] Reconfiguring daemon mgr.y on smithi079 2024-09-13T05:44:55.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.593695+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.593695+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.600978+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.600978+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.602671+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:55.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.602671+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:55.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.604417+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:55.990 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.604417+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-13T05:44:55.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.613600+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.613600+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' 2024-09-13T05:44:55.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: cephadm 2024-09-13T05:44:54.648406+0000 mgr.y (mgr.14152) 81 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-13T05:44:55.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: cephadm 2024-09-13T05:44:54.648406+0000 mgr.y (mgr.14152) 81 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-13T05:44:55.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.649150+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-13T05:44:55.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.649150+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-13T05:44:55.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.650927+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-13T05:44:55.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.650927+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-13T05:44:55.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.652324+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:55.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: audit 2024-09-13T05:44:54.652324+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-13T05:44:55.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: cephadm 2024-09-13T05:44:54.654095+0000 mgr.y (mgr.14152) 82 : cephadm [INF] Reconfiguring daemon mgr.y on smithi079 2024-09-13T05:44:55.991 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:55 smithi079 bash[31923]: cephadm 2024-09-13T05:44:54.654095+0000 mgr.y (mgr.14152) 82 : cephadm [INF] Reconfiguring daemon mgr.y on smithi079 2024-09-13T05:44:56.782 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[22814]: cluster 2024-09-13T05:44:54.920814+0000 mgr.y (mgr.14152) 83 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:56.782 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[22814]: cluster 2024-09-13T05:44:54.920814+0000 mgr.y (mgr.14152) 83 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:56.782 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[22814]: cluster 2024-09-13T05:44:56.282344+0000 mon.a (mon.0) 264 : cluster [DBG] Standby manager daemon x started 2024-09-13T05:44:56.782 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[22814]: cluster 2024-09-13T05:44:56.282344+0000 mon.a (mon.0) 264 : cluster [DBG] Standby manager daemon x started 2024-09-13T05:44:56.782 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[22814]: audit 2024-09-13T05:44:56.284492+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-13T05:44:56.782 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[22814]: audit 2024-09-13T05:44:56.284492+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-13T05:44:56.782 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[22814]: audit 2024-09-13T05:44:56.285115+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-13T05:44:56.782 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[22814]: audit 2024-09-13T05:44:56.285115+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-13T05:44:56.783 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[22814]: audit 2024-09-13T05:44:56.286308+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-13T05:44:56.783 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[22814]: audit 2024-09-13T05:44:56.286308+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-13T05:44:56.783 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[22814]: audit 2024-09-13T05:44:56.286862+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-13T05:44:56.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:56 smithi139 bash[24829]: cluster 2024-09-13T05:44:54.920814+0000 mgr.y (mgr.14152) 83 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:56.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:56 smithi139 bash[24829]: cluster 2024-09-13T05:44:54.920814+0000 mgr.y (mgr.14152) 83 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:56.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:56 smithi139 bash[24829]: cluster 2024-09-13T05:44:56.282344+0000 mon.a (mon.0) 264 : cluster [DBG] Standby manager daemon x started 2024-09-13T05:44:56.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:56 smithi139 bash[24829]: cluster 2024-09-13T05:44:56.282344+0000 mon.a (mon.0) 264 : cluster [DBG] Standby manager daemon x started 2024-09-13T05:44:56.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:56 smithi139 bash[24829]: audit 2024-09-13T05:44:56.284492+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-13T05:44:56.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:56 smithi139 bash[24829]: audit 2024-09-13T05:44:56.284492+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-13T05:44:56.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:56 smithi139 bash[24829]: audit 2024-09-13T05:44:56.285115+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-13T05:44:56.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:56 smithi139 bash[24829]: audit 2024-09-13T05:44:56.285115+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-13T05:44:56.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:56 smithi139 bash[24829]: audit 2024-09-13T05:44:56.286308+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-13T05:44:56.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:56 smithi139 bash[24829]: audit 2024-09-13T05:44:56.286308+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-13T05:44:56.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:56 smithi139 bash[24829]: audit 2024-09-13T05:44:56.286862+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-13T05:44:56.872 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:56 smithi139 bash[24829]: audit 2024-09-13T05:44:56.286862+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-13T05:44:57.087 INFO:teuthology.orchestra.run.smithi079.stderr:Non-zero exit code 1 from /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --ulimit nofile=1048576 --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 -e NODE_NAME=smithi079 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/bf551932-7192-11ef-bceb-c7b262605968:/var/run/ceph:z -v /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/crash:/var/lib/ceph/crash:z -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /:/rootfs:rslave -v /tmp/ceph-tmptkn46s6m:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp252o1dcq:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 lvm zap /dev/vg_nvme/lv_4 2024-09-13T05:44:57.087 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr --> Zapping: /dev/vg_nvme/lv_4 2024-09-13T05:44:57.087 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr --> Removing all BlueStore signature on /dev/vg_nvme/lv_4 if any... 2024-09-13T05:44:57.087 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr Running command: /usr/bin/ceph-bluestore-tool zap-device /dev/vg_nvme/lv_4 --yes-i-really-really-mean-it 2024-09-13T05:44:57.087 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr stderr: Unknown options: [zap-device,/dev/vg_nvme/lv_4] 2024-09-13T05:44:57.087 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr Traceback (most recent call last): 2024-09-13T05:44:57.087 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr File "/usr/sbin/ceph-volume", line 33, in 2024-09-13T05:44:57.088 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr sys.exit(load_entry_point('ceph-volume==1.0.0', 'console_scripts', 'ceph-volume')()) 2024-09-13T05:44:57.088 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr File "/usr/lib/python3.9/site-packages/ceph_volume/main.py", line 54, in __init__ 2024-09-13T05:44:57.088 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr self.main(self.argv) 2024-09-13T05:44:57.088 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr File "/usr/lib/python3.9/site-packages/ceph_volume/decorators.py", line 59, in newfunc 2024-09-13T05:44:57.088 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr return f(*a, **kw) 2024-09-13T05:44:57.088 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr File "/usr/lib/python3.9/site-packages/ceph_volume/main.py", line 166, in main 2024-09-13T05:44:57.088 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr terminal.dispatch(self.mapper, subcommand_args) 2024-09-13T05:44:57.088 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr File "/usr/lib/python3.9/site-packages/ceph_volume/terminal.py", line 194, in dispatch 2024-09-13T05:44:57.088 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr instance.main() 2024-09-13T05:44:57.088 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr File "/usr/lib/python3.9/site-packages/ceph_volume/devices/lvm/main.py", line 46, in main 2024-09-13T05:44:57.088 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr terminal.dispatch(self.mapper, self.argv) 2024-09-13T05:44:57.088 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr File "/usr/lib/python3.9/site-packages/ceph_volume/terminal.py", line 194, in dispatch 2024-09-13T05:44:57.088 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr instance.main() 2024-09-13T05:44:57.089 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr File "/usr/lib/python3.9/site-packages/ceph_volume/devices/lvm/zap.py", line 430, in main 2024-09-13T05:44:57.089 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr self.zap() 2024-09-13T05:44:57.089 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr File "/usr/lib/python3.9/site-packages/ceph_volume/decorators.py", line 16, in is_root 2024-09-13T05:44:57.089 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr return func(*a, **kw) 2024-09-13T05:44:57.089 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr File "/usr/lib/python3.9/site-packages/ceph_volume/devices/lvm/zap.py", line 302, in zap 2024-09-13T05:44:57.089 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr self.zap_lv(device) 2024-09-13T05:44:57.090 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr File "/usr/lib/python3.9/site-packages/ceph_volume/devices/lvm/zap.py", line 197, in zap_lv 2024-09-13T05:44:57.090 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr zap_device(device.path) 2024-09-13T05:44:57.091 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr File "/usr/lib/python3.9/site-packages/ceph_volume/devices/lvm/zap.py", line 25, in zap_device 2024-09-13T05:44:57.091 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr zap_bluestore(path) 2024-09-13T05:44:57.091 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr File "/usr/lib/python3.9/site-packages/ceph_volume/devices/lvm/zap.py", line 36, in zap_bluestore 2024-09-13T05:44:57.091 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr process.run([ 2024-09-13T05:44:57.091 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr File "/usr/lib/python3.9/site-packages/ceph_volume/process.py", line 147, in run 2024-09-13T05:44:57.091 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr raise RuntimeError(msg) 2024-09-13T05:44:57.091 INFO:teuthology.orchestra.run.smithi079.stderr:/usr/bin/docker: stderr RuntimeError: command returned non-zero exit status: 1 2024-09-13T05:44:57.091 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2024-09-13T05:44:57.091 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main 2024-09-13T05:44:57.095 INFO:teuthology.orchestra.run.smithi079.stderr: return _run_code(code, main_globals, None, 2024-09-13T05:44:57.095 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib/python3.10/runpy.py", line 86, in _run_code 2024-09-13T05:44:57.095 INFO:teuthology.orchestra.run.smithi079.stderr: exec(code, run_globals) 2024-09-13T05:44:57.095 INFO:teuthology.orchestra.run.smithi079.stderr: File "/tmp/tmp6vuxujxz.cephadm.build/app/__main__.py", line 5628, in 2024-09-13T05:44:57.095 INFO:teuthology.orchestra.run.smithi079.stderr: File "/tmp/tmp6vuxujxz.cephadm.build/app/__main__.py", line 5616, in main 2024-09-13T05:44:57.095 INFO:teuthology.orchestra.run.smithi079.stderr: File "/tmp/tmp6vuxujxz.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-13T05:44:57.095 INFO:teuthology.orchestra.run.smithi079.stderr: File "/tmp/tmp6vuxujxz.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-13T05:44:57.095 INFO:teuthology.orchestra.run.smithi079.stderr: File "/tmp/tmp6vuxujxz.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-13T05:44:57.095 INFO:teuthology.orchestra.run.smithi079.stderr: File "/tmp/tmp6vuxujxz.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-13T05:44:57.096 INFO:teuthology.orchestra.run.smithi079.stderr: File "/tmp/tmp6vuxujxz.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-13T05:44:57.096 INFO:teuthology.orchestra.run.smithi079.stderr: File "/tmp/tmp6vuxujxz.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-13T05:44:57.096 INFO:teuthology.orchestra.run.smithi079.stderr:RuntimeError: Failed command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --ulimit nofile=1048576 --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 -e NODE_NAME=smithi079 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/bf551932-7192-11ef-bceb-c7b262605968:/var/run/ceph:z -v /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/crash:/var/lib/ceph/crash:z -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /:/rootfs:rslave -v /tmp/ceph-tmptkn46s6m:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp252o1dcq:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 lvm zap /dev/vg_nvme/lv_4 2024-09-13T05:44:57.149 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[22814]: audit 2024-09-13T05:44:56.286862+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-13T05:44:57.150 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[31923]: cluster 2024-09-13T05:44:54.920814+0000 mgr.y (mgr.14152) 83 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:57.150 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[31923]: cluster 2024-09-13T05:44:54.920814+0000 mgr.y (mgr.14152) 83 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T05:44:57.150 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[31923]: cluster 2024-09-13T05:44:56.282344+0000 mon.a (mon.0) 264 : cluster [DBG] Standby manager daemon x started 2024-09-13T05:44:57.150 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[31923]: cluster 2024-09-13T05:44:56.282344+0000 mon.a (mon.0) 264 : cluster [DBG] Standby manager daemon x started 2024-09-13T05:44:57.150 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[31923]: audit 2024-09-13T05:44:56.284492+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-13T05:44:57.150 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[31923]: audit 2024-09-13T05:44:56.284492+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-13T05:44:57.150 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[31923]: audit 2024-09-13T05:44:56.285115+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-13T05:44:57.150 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[31923]: audit 2024-09-13T05:44:56.285115+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-13T05:44:57.150 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[31923]: audit 2024-09-13T05:44:56.286308+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-13T05:44:57.150 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[31923]: audit 2024-09-13T05:44:56.286308+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-13T05:44:57.151 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[31923]: audit 2024-09-13T05:44:56.286862+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-13T05:44:57.151 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:56 smithi079 bash[31923]: audit 2024-09-13T05:44:56.286862+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.139:0/2926708325' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-13T05:44:57.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:44:57.152 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/qa/tasks/cephadm.py", line 1121, in ceph_osds remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4' 2024-09-13T05:44:57.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T05:44:57.168 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T05:44:57.183 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T05:44:57.183 DEBUG:teuthology.orchestra.run.smithi079:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T05:44:57.218 DEBUG:teuthology.orchestra.run.smithi139:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T05:44:57.230 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T05:44:57.231 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-13T05:44:57.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-bf551932-7192-11ef-bceb-c7b262605968@mon.a 2024-09-13T05:44:57.475 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:57 smithi079 systemd[1]: Stopping Ceph mon.a for bf551932-7192-11ef-bceb-c7b262605968... 2024-09-13T05:44:57.988 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:57 smithi079 bash[31923]: cluster 2024-09-13T05:44:56.635988+0000 mon.a (mon.0) 265 : cluster [DBG] mgrmap e15: y(active, since 99s), standbys: x 2024-09-13T05:44:57.988 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:57 smithi079 bash[31923]: cluster 2024-09-13T05:44:56.635988+0000 mon.a (mon.0) 265 : cluster [DBG] mgrmap e15: y(active, since 99s), standbys: x 2024-09-13T05:44:57.988 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:57 smithi079 bash[31923]: audit 2024-09-13T05:44:56.636220+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-13T05:44:57.989 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:57 smithi079 bash[31923]: audit 2024-09-13T05:44:56.636220+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-13T05:44:57.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:57 smithi079 bash[22814]: cluster 2024-09-13T05:44:56.635988+0000 mon.a (mon.0) 265 : cluster [DBG] mgrmap e15: y(active, since 99s), standbys: x 2024-09-13T05:44:57.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:57 smithi079 bash[22814]: cluster 2024-09-13T05:44:56.635988+0000 mon.a (mon.0) 265 : cluster [DBG] mgrmap e15: y(active, since 99s), standbys: x 2024-09-13T05:44:57.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:57 smithi079 bash[22814]: audit 2024-09-13T05:44:56.636220+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-13T05:44:57.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:57 smithi079 bash[22814]: audit 2024-09-13T05:44:56.636220+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-13T05:44:57.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:57 smithi079 bash[22814]: debug 2024-09-13T05:44:57.741+0000 7f1d7b929640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-13T05:44:57.989 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:57 smithi079 bash[22814]: debug 2024-09-13T05:44:57.741+0000 7f1d7b929640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T05:44:58.121 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:57 smithi139 bash[24829]: cluster 2024-09-13T05:44:56.635988+0000 mon.a (mon.0) 265 : cluster [DBG] mgrmap e15: y(active, since 99s), standbys: x 2024-09-13T05:44:58.121 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:57 smithi139 bash[24829]: cluster 2024-09-13T05:44:56.635988+0000 mon.a (mon.0) 265 : cluster [DBG] mgrmap e15: y(active, since 99s), standbys: x 2024-09-13T05:44:58.121 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:57 smithi139 bash[24829]: audit 2024-09-13T05:44:56.636220+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-13T05:44:58.121 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:44:57 smithi139 bash[24829]: audit 2024-09-13T05:44:56.636220+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14152 172.21.15.79:0/1707890974' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-13T05:44:58.867 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 13 05:44:58 smithi079 bash[32784]: ceph-bf551932-7192-11ef-bceb-c7b262605968-mon-a 2024-09-13T05:44:58.882 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf551932-7192-11ef-bceb-c7b262605968@mon.a.service' 2024-09-13T05:44:58.938 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T05:44:58.939 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-13T05:44:58.939 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-09-13T05:44:58.939 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-bf551932-7192-11ef-bceb-c7b262605968@mon.c 2024-09-13T05:44:59.238 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:58 smithi079 systemd[1]: Stopping Ceph mon.c for bf551932-7192-11ef-bceb-c7b262605968... 2024-09-13T05:44:59.238 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:59 smithi079 bash[31923]: debug 2024-09-13T05:44:59.089+0000 7fbc76109640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-13T05:44:59.238 INFO:journalctl@ceph.mon.c.smithi079.stdout:Sep 13 05:44:59 smithi079 bash[31923]: debug 2024-09-13T05:44:59.089+0000 7fbc76109640 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-09-13T05:45:00.126 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf551932-7192-11ef-bceb-c7b262605968@mon.c.service' 2024-09-13T05:45:00.145 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T05:45:00.145 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-09-13T05:45:00.146 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-09-13T05:45:00.146 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-bf551932-7192-11ef-bceb-c7b262605968@mon.b 2024-09-13T05:45:00.415 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:45:00 smithi139 systemd[1]: Stopping Ceph mon.b for bf551932-7192-11ef-bceb-c7b262605968... 2024-09-13T05:45:00.415 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:45:00 smithi139 bash[24829]: debug 2024-09-13T05:45:00.292+0000 7fee7a5a8640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-13T05:45:00.415 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 13 05:45:00 smithi139 bash[24829]: debug 2024-09-13T05:45:00.292+0000 7fee7a5a8640 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T05:45:00.910 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf551932-7192-11ef-bceb-c7b262605968@mon.b.service' 2024-09-13T05:45:00.936 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T05:45:00.937 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-09-13T05:45:00.937 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-13T05:45:00.937 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-bf551932-7192-11ef-bceb-c7b262605968@mgr.y 2024-09-13T05:45:01.238 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:45:00 smithi079 systemd[1]: Stopping Ceph mgr.y for bf551932-7192-11ef-bceb-c7b262605968... 2024-09-13T05:45:01.238 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:45:01 smithi079 bash[23069]: debug 2024-09-13T05:45:01.085+0000 7f7af9cf6640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-13T05:45:01.238 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 13 05:45:01 smithi079 bash[23069]: debug 2024-09-13T05:45:01.085+0000 7f7af9cf6640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-13T05:45:01.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf551932-7192-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-13T05:45:01.895 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T05:45:01.896 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-13T05:45:01.896 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-13T05:45:01.896 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-bf551932-7192-11ef-bceb-c7b262605968@mgr.x 2024-09-13T05:45:02.232 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Sep 13 05:45:01 smithi139 systemd[1]: Stopping Ceph mgr.x for bf551932-7192-11ef-bceb-c7b262605968... 2024-09-13T05:45:02.607 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Sep 13 05:45:02 smithi139 bash[26004]: ceph-bf551932-7192-11ef-bceb-c7b262605968-mgr-x 2024-09-13T05:45:02.622 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf551932-7192-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-13T05:45:02.650 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T05:45:02.650 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-13T05:45:02.650 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf551932-7192-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T05:45:02.835 INFO:teuthology.orchestra.run.smithi079.stdout:Deleting cluster with fsid: bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:45:05.172 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf551932-7192-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T05:45:05.356 INFO:teuthology.orchestra.run.smithi139.stdout:Deleting cluster with fsid: bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:45:07.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T05:45:07.570 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T05:45:07.582 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T05:45:07.584 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/gabrioux-2024-09-13_05:00:55-orch:cephadm-wip-guits-main-2024-09-12-1245-distro-default-smithi/7903136/remote/smithi079/crash 2024-09-13T05:45:07.584 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/crash -- . 2024-09-13T05:45:07.625 INFO:teuthology.orchestra.run.smithi079.stderr:tar: /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T05:45:07.625 INFO:teuthology.orchestra.run.smithi079.stderr:tar: Error is not recoverable: exiting now 2024-09-13T05:45:07.628 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/gabrioux-2024-09-13_05:00:55-orch:cephadm-wip-guits-main-2024-09-12-1245-distro-default-smithi/7903136/remote/smithi139/crash 2024-09-13T05:45:07.629 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/crash -- . 2024-09-13T05:45:07.641 INFO:teuthology.orchestra.run.smithi139.stderr:tar: /var/lib/ceph/bf551932-7192-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T05:45:07.641 INFO:teuthology.orchestra.run.smithi139.stderr:tar: Error is not recoverable: exiting now 2024-09-13T05:45:07.641 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T05:45:07.642 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v CEPHADM_STRAY_DAEMON | head -n 1 2024-09-13T05:45:07.688 INFO:tasks.cephadm:Compressing logs... 2024-09-13T05:45:07.688 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T05:45:07.731 DEBUG:teuthology.orchestra.run.smithi139:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T05:45:07.739 INFO:teuthology.orchestra.run.smithi079.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-09-13T05:45:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-09-13T05:45:07.750 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T05:45:07.751 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-13T05:45:07.751 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-13T05:45:07.752 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T05:45:07.752 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.log 2024-09-13T05:45:07.752 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T05:45:07.753 INFO:teuthology.orchestra.run.smithi079.stderr: 83.5% -- replaced with /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T05:45:07.753 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-13T05:45:07.753 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T05:45:07.753 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T05:45:07.754 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T05:45:07.754 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.audit.log: 91.0% -- replaced with /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T05:45:07.755 INFO:teuthology.orchestra.run.smithi079.stderr: 91.5% -- replaced with /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T05:45:07.755 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T05:45:07.756 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-13T05:45:07.756 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.log 2024-09-13T05:45:07.756 INFO:teuthology.orchestra.run.smithi139.stderr: 74.2% -- replaced with /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T05:45:07.757 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T05:45:07.757 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T05:45:07.757 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-volume.log: 81.3% -- replaced with /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T05:45:07.757 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-13T05:45:07.758 INFO:teuthology.orchestra.run.smithi079.stderr: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T05:45:07.758 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.audit.log: 89.7% -- replaced with /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T05:45:07.758 INFO:teuthology.orchestra.run.smithi139.stderr: 87.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T05:45:07.758 INFO:teuthology.orchestra.run.smithi139.stderr: 89.6% -- replaced with /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T05:45:07.759 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mon.b.log: 88.9% -- replaced with /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-13T05:45:07.766 INFO:teuthology.orchestra.run.smithi079.stderr: 92.8% -- replaced with /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-13T05:45:07.772 INFO:teuthology.orchestra.run.smithi139.stderr: 92.6% -- replaced with /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-13T05:45:07.773 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-09-13T05:45:07.773 INFO:teuthology.orchestra.run.smithi139.stderr:real 0m0.038s 2024-09-13T05:45:07.773 INFO:teuthology.orchestra.run.smithi139.stderr:user 0m0.035s 2024-09-13T05:45:07.773 INFO:teuthology.orchestra.run.smithi139.stderr:sys 0m0.011s 2024-09-13T05:45:07.782 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-13T05:45:07.817 INFO:teuthology.orchestra.run.smithi079.stderr: 91.6% -- replaced with /var/log/ceph/bf551932-7192-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-13T05:45:07.817 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-13T05:45:07.817 INFO:teuthology.orchestra.run.smithi079.stderr:real 0m0.082s 2024-09-13T05:45:07.817 INFO:teuthology.orchestra.run.smithi079.stderr:user 0m0.120s 2024-09-13T05:45:07.817 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m0.017s 2024-09-13T05:45:07.817 INFO:tasks.cephadm:Archiving logs... 2024-09-13T05:45:07.818 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-13_05:00:55-orch:cephadm-wip-guits-main-2024-09-12-1245-distro-default-smithi/7903136/remote/smithi079/log 2024-09-13T05:45:07.819 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T05:45:07.889 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-13_05:00:55-orch:cephadm-wip-guits-main-2024-09-12-1245-distro-default-smithi/7903136/remote/smithi139/log 2024-09-13T05:45:07.890 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T05:45:07.911 INFO:tasks.cephadm:Removing cluster... 2024-09-13T05:45:07.911 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf551932-7192-11ef-bceb-c7b262605968 --force 2024-09-13T05:45:08.094 INFO:teuthology.orchestra.run.smithi079.stdout:Deleting cluster with fsid: bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:45:09.421 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf551932-7192-11ef-bceb-c7b262605968 --force 2024-09-13T05:45:09.606 INFO:teuthology.orchestra.run.smithi139.stdout:Deleting cluster with fsid: bf551932-7192-11ef-bceb-c7b262605968 2024-09-13T05:45:10.985 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T05:45:10.985 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T05:45:10.992 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T05:45:10.998 INFO:tasks.cephadm:Teardown complete 2024-09-13T05:45:10.998 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/qa/tasks/cephadm.py", line 2334, in task with contextutil.nested( File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/qa/tasks/cephadm.py", line 1962, in initialize_config yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/qa/tasks/cephadm.py", line 1121, in ceph_osds remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4' 2024-09-13T05:45:11.233 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4af83e9a69fe45d885ccfaeaa89fe7ac Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/qa/tasks/cephadm.py", line 2334, in task with contextutil.nested( File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/qa/tasks/cephadm.py", line 1962, in initialize_config yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3/qa/tasks/cephadm.py", line 1121, in ceph_osds remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4' 2024-09-13T05:45:11.236 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T05:45:11.247 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T05:45:11.269 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T05:45:11.269 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T05:45:11.290 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T05:45:11.369 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T05:45:11.376 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T05:45:11.377 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T05:45:11.379 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T05:45:11.388 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T05:45:11.388 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2024-09-13T05:45:11.389 INFO:teuthology.orchestra.run.smithi079.stdout:*hv01.front.sepi 67.205.162.81 3 u 39 64 77 0.138 -0.370 2.354 2024-09-13T05:45:11.389 INFO:teuthology.orchestra.run.smithi079.stdout:+hv02.front.sepi 63.231.80.2 3 u 37 64 77 0.090 -0.001 1.531 2024-09-13T05:45:11.389 INFO:teuthology.orchestra.run.smithi079.stdout:+hv03.front.sepi 74.6.168.72 3 u 35 64 77 0.086 -3.348 1.805 2024-09-13T05:45:11.389 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T05:45:11.391 INFO:teuthology.orchestra.run.smithi139.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T05:45:11.391 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================== 2024-09-13T05:45:11.391 INFO:teuthology.orchestra.run.smithi139.stdout:*hv01.front.sepi 67.205.162.81 3 u 38 64 77 0.140 -0.353 2.199 2024-09-13T05:45:11.391 INFO:teuthology.orchestra.run.smithi139.stdout:+hv02.front.sepi 63.231.80.2 3 u 32 64 77 0.097 -0.034 1.298 2024-09-13T05:45:11.392 INFO:teuthology.orchestra.run.smithi139.stdout:+hv03.front.sepi 74.6.168.72 3 u 39 64 77 0.110 -0.447 2.204 2024-09-13T05:45:11.392 INFO:teuthology.orchestra.run.smithi139.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T05:45:11.392 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T05:45:11.407 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T05:45:11.408 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T05:45:11.422 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T05:45:11.430 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T05:45:11.438 INFO:teuthology.task.internal:Duration was 821.515246 seconds 2024-09-13T05:45:11.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T05:45:11.446 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T05:45:11.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T05:45:11.449 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T05:45:11.486 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T05:45:11.486 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2024-09-13T05:45:11.486 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T05:45:11.539 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T05:45:11.539 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T05:45:11.549 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T05:45:11.549 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T05:45:11.583 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T05:45:11.622 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T05:45:11.622 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T05:45:11.659 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T05:45:11.746 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T05:45:11.754 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T05:45:11.754 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T05:45:11.765 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T05:45:11.776 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T05:45:11.785 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T05:45:11.811 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T05:45:11.819 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2024-09-13T05:45:11.827 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2024-09-13T05:45:11.922 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T05:45:11.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:45:11.970 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T05:45:11.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:45:11.975 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T05:45:11.984 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T05:45:11.985 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-13_05:00:55-orch:cephadm-wip-guits-main-2024-09-12-1245-distro-default-smithi/7903136/remote/smithi079 2024-09-13T05:45:11.985 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T05:45:12.037 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-13_05:00:55-orch:cephadm-wip-guits-main-2024-09-12-1245-distro-default-smithi/7903136/remote/smithi139 2024-09-13T05:45:12.037 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T05:45:12.059 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T05:45:12.059 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T05:45:12.075 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T05:45:12.101 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T05:45:12.111 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T05:45:12.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T05:45:12.126 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T05:45:12.127 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T05:45:12.129 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T05:45:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: 658463 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 05:45 /home/ubuntu/cephtest 2024-09-13T05:45:12.150 INFO:teuthology.orchestra.run.smithi139.stdout: 658625 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 05:45 /home/ubuntu/cephtest 2024-09-13T05:45:12.151 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T05:45:12.160 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T05:45:12.181 INFO:teuthology.run:Summary data: description: orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} duration: 821.5152459144592 failure_reason: 'Command failed on smithi079 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d608eb13dd49ee7b4b1637dbcf4f78b31ddd3d3 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf551932-7192-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4''' flavor: default owner: scheduled_gabrioux@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=4af83e9a69fe45d885ccfaeaa89fe7ac status: fail success: false 2024-09-13T05:45:12.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T05:45:12.271 INFO:teuthology.run:FAIL