2024-09-17T10:46:29.171 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T10:46:29.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T10:46:29.276 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-16_20:08:15-orch-main-distro-default-smithi/7907709 branch: main description: orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_basic} email: ceph-qa@ceph.com first_in_suite: false job_id: '7907709' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-16_20:08:15-orch-main-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-only-match: - CEPHADM_ sha1: 7498493279982dfe87f00616198a5967475f6169 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 7498493279982dfe87f00616198a5967475f6169 workunit: branch: main sha1: 2b698643d05f73e79c2d2888228947a84a4ac0bd owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - host.a - mon.a - mgr.x - osd.0 - osd.1 - client.0 - - host.b - cephadm.exclude seed: 3649 sha1: 7498493279982dfe87f00616198a5967475f6169 sleep_before_teardown: 0 subset: 42/64 suite: orch suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_2b698643d05f73e79c2d2888228947a84a4ac0bd/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 2b698643d05f73e79c2d2888228947a84a4ac0bd targets: smithi066.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAIRz9RmU3Zg4VW4b9IvH3X0fE8OyYtPllt/SCV7Oo5PT3pO1X3cnsl1d3Nr1Re0/+rOXDOm6NB5SC04MekYP6Y= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDyh8EMDA6Vs4j/ezD3mSRXFx1HELaCBC/YdvkmmasBnyxDDYmrsVjTCLmfChRSKiMY5sUyeQUkUfVGFa7uBZQ0= tasks: - cephadm.configure_samba_client_container: role: host.b - cephadm: single_host_defaults: true - cephadm.shell: host.a: - ceph fs volume create cephfs - cephadm.wait_for_service: service: mds.cephfs - cephadm.shell: host.a: - cmd: ceph fs subvolumegroup create cephfs smb - cmd: ceph fs subvolume create cephfs sv1 --group-name=smb --mode=0777 - cmd: ceph fs subvolume create cephfs sv2 --group-name=smb --mode=0777 - cmd: ceph mgr module enable smb - cmd: sleep 30 - cmd: 'ceph smb cluster create modusr1 user --define-user-pass=user1%t3stP4ss1 --define-user-pass=user2%t3stP4ss2 --placement=count:1 ' - cmd: ceph smb share create modusr1 share1 cephfs / --subvolume=smb/sv1 - cmd: ceph smb share create modusr1 share2 cephfs / --subvolume=smb/sv2 - cephadm.wait_for_service: service: smb.modusr1 - cephadm.exec: host.b: - sleep 30 - '{{ctx.samba_client_container_cmd|join('' '')}} smbclient -U user1%t3stP4ss1 //{{''host.a''|role_to_remote|attr(''ip_address'')}}/share1 -c ls' - '{{ctx.samba_client_container_cmd|join('' '')}} smbclient -U user2%t3stP4ss2 //{{''host.a''|role_to_remote|attr(''ip_address'')}}/share2 -c ls' - cephadm.shell: host.a: - cmd: ceph smb share rm modusr1 share2 - cmd: ceph smb share rm modusr1 share1 - cmd: ceph smb cluster rm modusr1 - cephadm.wait_for_service_not_present: service: smb.modusr1 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_20:08:15 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T10:46:29.276 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_2b698643d05f73e79c2d2888228947a84a4ac0bd/qa; will attempt to use it 2024-09-17T10:46:29.277 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_2b698643d05f73e79c2d2888228947a84a4ac0bd/qa/tasks 2024-09-17T10:46:29.277 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T10:46:29.279 INFO:teuthology.task.internal:Checking packages... 2024-09-17T10:46:29.301 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7498493279982dfe87f00616198a5967475f6169' 2024-09-17T10:46:29.301 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T10:46:29.301 INFO:teuthology.packaging:ref: None 2024-09-17T10:46:29.301 INFO:teuthology.packaging:tag: None 2024-09-17T10:46:29.301 INFO:teuthology.packaging:branch: main 2024-09-17T10:46:29.301 INFO:teuthology.packaging:sha1: 7498493279982dfe87f00616198a5967475f6169 2024-09-17T10:46:29.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-09-17T10:46:29.519 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4937-g74984932-1jammy 2024-09-17T10:46:29.521 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T10:46:29.528 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T10:46:29.528 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T10:46:29.540 INFO:teuthology.task.internal:Saving configuration 2024-09-17T10:46:29.552 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T10:46:29.558 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T10:46:29.583 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_20:08:15-orch-main-distro-default-smithi/7907709', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 10:40:06.717808', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGKtjnqxo1KU9s5DBALr3rI7JmWjctR2ImV/+bYewfwf'} 2024-09-17T10:46:29.607 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_20:08:15-orch-main-distro-default-smithi/7907709', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 10:40:06.718901', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqbkhuX2aPLcMSc26SjaPVBE32woX2dLGOlB0rPJTKl'} 2024-09-17T10:46:29.608 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T10:46:29.613 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['host.a', 'mon.a', 'mgr.x', 'osd.0', 'osd.1', 'client.0'] 2024-09-17T10:46:29.613 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.b', 'cephadm.exclude'] 2024-09-17T10:46:29.614 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T10:46:29.677 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0fe5c5ee60>, signals=[15]) 2024-09-17T10:46:29.678 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T10:46:29.686 INFO:teuthology.task.internal:Opening connections... 2024-09-17T10:46:29.687 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2024-09-17T10:46:29.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T10:46:29.769 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2024-09-17T10:46:29.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T10:46:29.850 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T10:46:29.856 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-09-17T10:46:29.862 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-09-17T10:46:29.862 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-09-17T10:46:29.910 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T10:46:29.910 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Ubuntu" 2024-09-17T10:46:29.910 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="22.04" 2024-09-17T10:46:29.911 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T10:46:29.911 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_CODENAME=jammy 2024-09-17T10:46:29.911 INFO:teuthology.orchestra.run.smithi066.stdout:ID=ubuntu 2024-09-17T10:46:29.911 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE=debian 2024-09-17T10:46:29.911 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T10:46:29.911 INFO:teuthology.orchestra.run.smithi066.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T10:46:29.911 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T10:46:29.911 INFO:teuthology.orchestra.run.smithi066.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T10:46:29.911 INFO:teuthology.orchestra.run.smithi066.stdout:UBUNTU_CODENAME=jammy 2024-09-17T10:46:29.912 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-09-17T10:46:29.937 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-09-17T10:46:29.942 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-09-17T10:46:29.942 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-09-17T10:46:29.992 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T10:46:29.992 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2024-09-17T10:46:29.992 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2024-09-17T10:46:29.992 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T10:46:29.992 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2024-09-17T10:46:29.992 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2024-09-17T10:46:29.992 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2024-09-17T10:46:29.992 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T10:46:29.992 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T10:46:29.993 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T10:46:29.993 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T10:46:29.993 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2024-09-17T10:46:29.993 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-09-17T10:46:30.011 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T10:46:30.019 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T10:46:30.024 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T10:46:30.024 DEBUG:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2024-09-17T10:46:30.027 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2024-09-17T10:46:30.039 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T10:46:30.045 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T10:46:30.045 DEBUG:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2024-09-17T10:46:30.071 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2024-09-17T10:46:30.157 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T10:46:30.212 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T10:46:30.227 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T10:46:30.227 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T10:46:30.227 DEBUG:teuthology.orchestra.run.smithi066:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T10:46:30.228 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T10:46:30.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T10:46:30.232 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-09-17T10:46:30.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T10:46:30.233 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-09-17T10:46:30.278 INFO:teuthology.orchestra.run.smithi066.stdout:5.15.0-56-generic 2024-09-17T10:46:30.279 INFO:teuthology.task.kernel:Running kernel on smithi066: 5.15.0-56-generic 2024-09-17T10:46:30.279 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get clean 2024-09-17T10:46:30.280 INFO:teuthology.orchestra.run.smithi161.stdout:5.15.0-56-generic 2024-09-17T10:46:30.281 INFO:teuthology.task.kernel:Running kernel on smithi161: 5.15.0-56-generic 2024-09-17T10:46:30.281 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get clean 2024-09-17T10:46:30.432 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get update 2024-09-17T10:46:30.436 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2024-09-17T10:46:30.575 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T10:46:30.590 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T10:46:30.592 INFO:teuthology.orchestra.run.smithi066.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T10:46:30.655 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T10:46:30.688 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T10:46:30.707 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T10:46:30.770 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T10:46:30.799 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T10:46:30.815 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T10:46:30.884 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T10:46:30.905 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-17T10:46:30.909 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T10:46:30.912 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T10:46:30.912 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T10:46:30.913 INFO:teuthology.orchestra.run.smithi066.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-17T10:46:30.920 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T10:46:30.923 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T10:46:30.923 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T10:46:30.933 INFO:teuthology.orchestra.run.smithi066.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-17T10:46:30.936 INFO:teuthology.orchestra.run.smithi066.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T10:46:30.936 INFO:teuthology.orchestra.run.smithi066.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-17T10:46:30.942 INFO:teuthology.orchestra.run.smithi066.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-17T10:46:30.943 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T10:46:30.943 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T10:46:30.947 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T10:46:30.947 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T10:46:30.947 INFO:teuthology.orchestra.run.smithi066.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-17T10:46:30.948 INFO:teuthology.orchestra.run.smithi066.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T10:46:30.949 INFO:teuthology.orchestra.run.smithi066.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T10:46:30.949 INFO:teuthology.orchestra.run.smithi066.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T10:46:30.953 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T10:46:30.955 INFO:teuthology.orchestra.run.smithi066.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T10:46:30.961 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T10:46:30.964 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-17T10:46:30.964 INFO:teuthology.orchestra.run.smithi066.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T10:46:30.964 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T10:46:30.987 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T10:46:30.987 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T10:46:30.987 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T10:46:30.988 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T10:46:30.988 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T10:46:30.989 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T10:46:30.991 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T10:46:30.992 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T10:46:31.009 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T10:46:31.009 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T10:46:31.009 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T10:46:31.126 INFO:teuthology.orchestra.run.smithi066.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T10:46:31.146 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T10:46:31.265 INFO:teuthology.orchestra.run.smithi066.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T10:46:31.461 INFO:teuthology.orchestra.run.smithi066.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T10:46:31.567 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-17T10:46:31.583 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T10:46:31.592 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T10:46:31.593 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T10:46:31.594 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-17T10:46:31.621 INFO:teuthology.orchestra.run.smithi066.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T10:46:31.635 INFO:teuthology.orchestra.run.smithi066.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T10:46:31.636 INFO:teuthology.orchestra.run.smithi066.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T10:46:31.690 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-17T10:46:31.701 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T10:46:31.702 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-17T10:46:31.706 INFO:teuthology.orchestra.run.smithi066.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T10:46:31.710 INFO:teuthology.orchestra.run.smithi066.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T10:46:31.725 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-17T10:46:31.726 INFO:teuthology.orchestra.run.smithi066.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T10:46:31.726 INFO:teuthology.orchestra.run.smithi066.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T10:46:31.747 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-17T10:46:31.747 INFO:teuthology.orchestra.run.smithi066.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T10:46:31.750 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T10:46:31.753 INFO:teuthology.orchestra.run.smithi161.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T10:46:31.754 INFO:teuthology.orchestra.run.smithi161.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T10:46:31.754 INFO:teuthology.orchestra.run.smithi161.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T10:46:31.776 INFO:teuthology.orchestra.run.smithi066.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T10:46:31.781 INFO:teuthology.orchestra.run.smithi066.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-17T10:46:31.785 INFO:teuthology.orchestra.run.smithi066.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T10:46:31.787 INFO:teuthology.orchestra.run.smithi066.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T10:46:31.834 INFO:teuthology.orchestra.run.smithi161.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T10:46:31.862 INFO:teuthology.orchestra.run.smithi066.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T10:46:31.862 INFO:teuthology.orchestra.run.smithi066.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T10:46:31.862 INFO:teuthology.orchestra.run.smithi066.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T10:46:31.864 INFO:teuthology.orchestra.run.smithi066.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T10:46:31.866 INFO:teuthology.orchestra.run.smithi066.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T10:46:31.867 INFO:teuthology.orchestra.run.smithi066.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T10:46:31.867 INFO:teuthology.orchestra.run.smithi066.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T10:46:31.868 INFO:teuthology.orchestra.run.smithi066.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T10:46:31.949 INFO:teuthology.orchestra.run.smithi066.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T10:46:31.949 INFO:teuthology.orchestra.run.smithi066.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T10:46:37.266 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 16.1 MB in 2s (7,500 kB/s) 2024-09-17T10:46:37.529 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 16.1 MB in 2s (7,198 kB/s) 2024-09-17T10:46:38.666 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-17T10:46:38.684 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T10:46:38.747 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-17T10:46:38.959 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-09-17T10:46:38.959 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-09-17T10:46:39.039 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-09-17T10:46:39.058 DEBUG:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T10:46:39.113 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-09-17T10:46:39.133 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T10:46:39.134 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T10:46:39.134 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T10:46:39.134 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T10:46:39.134 INFO:teuthology.orchestra.run.smithi161.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T10:46:39.135 INFO:teuthology.orchestra.run.smithi161.stdout: python2.7-minimal 2024-09-17T10:46:39.135 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T10:46:39.136 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2024-09-17T10:46:39.136 INFO:teuthology.orchestra.run.smithi161.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T10:46:39.136 INFO:teuthology.orchestra.run.smithi161.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T10:46:39.136 INFO:teuthology.orchestra.run.smithi161.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T10:46:39.137 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2024-09-17T10:46:39.138 INFO:teuthology.orchestra.run.smithi161.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T10:46:39.138 INFO:teuthology.orchestra.run.smithi161.stdout:Recommended packages: 2024-09-17T10:46:39.138 INFO:teuthology.orchestra.run.smithi161.stdout: thermald 2024-09-17T10:46:39.181 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2024-09-17T10:46:39.181 INFO:teuthology.orchestra.run.smithi161.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T10:46:39.181 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T10:46:39.181 INFO:teuthology.orchestra.run.smithi161.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T10:46:39.182 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2024-09-17T10:46:39.182 INFO:teuthology.orchestra.run.smithi161.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T10:46:39.329 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2024-09-17T10:46:39.329 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2024-09-17T10:46:39.361 INFO:teuthology.orchestra.run.smithi161.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T10:46:39.361 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 113 MB of archives. 2024-09-17T10:46:39.361 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T10:46:39.361 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T10:46:39.512 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T10:46:39.512 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T10:46:39.512 INFO:teuthology.orchestra.run.smithi066.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T10:46:39.513 INFO:teuthology.orchestra.run.smithi066.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T10:46:39.513 INFO:teuthology.orchestra.run.smithi066.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T10:46:39.513 INFO:teuthology.orchestra.run.smithi066.stdout: python2.7-minimal 2024-09-17T10:46:39.513 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T10:46:39.514 INFO:teuthology.orchestra.run.smithi066.stdout:The following additional packages will be installed: 2024-09-17T10:46:39.514 INFO:teuthology.orchestra.run.smithi066.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T10:46:39.514 INFO:teuthology.orchestra.run.smithi066.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T10:46:39.515 INFO:teuthology.orchestra.run.smithi066.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T10:46:39.516 INFO:teuthology.orchestra.run.smithi066.stdout:Suggested packages: 2024-09-17T10:46:39.516 INFO:teuthology.orchestra.run.smithi066.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T10:46:39.516 INFO:teuthology.orchestra.run.smithi066.stdout:Recommended packages: 2024-09-17T10:46:39.516 INFO:teuthology.orchestra.run.smithi066.stdout: thermald 2024-09-17T10:46:39.560 INFO:teuthology.orchestra.run.smithi066.stdout:The following NEW packages will be installed: 2024-09-17T10:46:39.560 INFO:teuthology.orchestra.run.smithi066.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T10:46:39.560 INFO:teuthology.orchestra.run.smithi066.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T10:46:39.560 INFO:teuthology.orchestra.run.smithi066.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T10:46:39.561 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be upgraded: 2024-09-17T10:46:39.562 INFO:teuthology.orchestra.run.smithi066.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T10:46:39.613 INFO:teuthology.orchestra.run.smithi066.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T10:46:39.613 INFO:teuthology.orchestra.run.smithi066.stdout:Need to get 113 MB of archives. 2024-09-17T10:46:39.613 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T10:46:39.613 INFO:teuthology.orchestra.run.smithi066.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T10:46:40.057 INFO:teuthology.orchestra.run.smithi066.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T10:46:40.164 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T10:46:40.782 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T10:46:40.987 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T10:46:40.987 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T10:46:40.987 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T10:46:41.114 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T10:46:41.130 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T10:46:41.136 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T10:46:41.539 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 113 MB in 2s (72.3 MB/s) 2024-09-17T10:46:41.837 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T10:46:43.336 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T10:46:43.336 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T10:46:43.337 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T10:46:43.690 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T10:46:43.769 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T10:46:43.789 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T10:46:43.793 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T10:46:43.917 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:46:44.170 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 113 MB in 5s (24.7 MB/s) 2024-09-17T10:46:44.325 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T10:46:46.009 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T10:46:46.030 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T10:46:46.116 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:46:46.329 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T10:46:46.333 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T10:46:46.397 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:46:46.537 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T10:46:46.558 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T10:46:46.587 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:46:48.522 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T10:46:48.543 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T10:46:48.637 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:46:49.125 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T10:46:49.146 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T10:46:49.183 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:46:53.085 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T10:46:53.211 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T10:46:53.503 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T10:46:53.615 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T10:46:53.926 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T10:46:53.949 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T10:46:54.018 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T10:46:56.040 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T10:46:56.166 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T10:46:56.481 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T10:46:56.585 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T10:46:56.888 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T10:46:56.910 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T10:46:56.955 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T10:46:59.999 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T10:47:00.041 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T10:47:00.074 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:47:02.874 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T10:47:02.956 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T10:47:02.993 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T10:47:02.994 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T10:47:03.031 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:47:03.352 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T10:47:03.473 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:47:03.599 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T10:47:03.737 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:47:05.153 INFO:teuthology.orchestra.run.smithi066.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T10:47:05.153 INFO:teuthology.orchestra.run.smithi066.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T10:47:05.153 INFO:teuthology.orchestra.run.smithi066.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T10:47:05.153 INFO:teuthology.orchestra.run.smithi066.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T10:47:05.335 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:47:05.602 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T10:47:05.724 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T10:47:06.992 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T10:47:07.096 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:47:07.197 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T10:47:07.273 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T10:47:07.318 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:47:07.399 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T10:47:07.541 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:47:08.635 INFO:teuthology.orchestra.run.smithi161.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T10:47:08.635 INFO:teuthology.orchestra.run.smithi161.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T10:47:08.635 INFO:teuthology.orchestra.run.smithi161.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T10:47:08.635 INFO:teuthology.orchestra.run.smithi161.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T10:47:08.777 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:47:08.977 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:47:09.044 INFO:teuthology.orchestra.run.smithi066.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T10:47:09.045 INFO:teuthology.orchestra.run.smithi066.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T10:47:10.203 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T10:47:10.329 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T10:47:10.455 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:47:11.882 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T10:47:11.945 INFO:teuthology.orchestra.run.smithi161.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T10:47:11.945 INFO:teuthology.orchestra.run.smithi161.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T10:47:23.391 INFO:teuthology.orchestra.run.smithi066.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T10:47:23.392 INFO:teuthology.orchestra.run.smithi066.stdout:Sourcing file `/etc/default/grub' 2024-09-17T10:47:23.404 INFO:teuthology.orchestra.run.smithi066.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T10:47:23.418 INFO:teuthology.orchestra.run.smithi066.stdout:Generating grub configuration file ... 2024-09-17T10:47:23.720 INFO:teuthology.orchestra.run.smithi066.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T10:47:23.733 INFO:teuthology.orchestra.run.smithi066.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T10:47:24.083 INFO:teuthology.orchestra.run.smithi066.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T10:47:24.089 INFO:teuthology.orchestra.run.smithi066.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T10:47:24.158 INFO:teuthology.orchestra.run.smithi066.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T10:47:24.163 INFO:teuthology.orchestra.run.smithi066.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T10:47:24.320 INFO:teuthology.orchestra.run.smithi066.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T10:47:24.320 INFO:teuthology.orchestra.run.smithi066.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T10:47:24.320 INFO:teuthology.orchestra.run.smithi066.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T10:47:24.363 INFO:teuthology.orchestra.run.smithi066.stdout:done 2024-09-17T10:47:24.790 DEBUG:teuthology.orchestra.run.smithi066:> dpkg -s linux-image-generic 2024-09-17T10:47:24.813 INFO:teuthology.orchestra.run.smithi066.stdout:Package: linux-image-generic 2024-09-17T10:47:24.813 INFO:teuthology.orchestra.run.smithi066.stdout:Status: install ok installed 2024-09-17T10:47:24.813 INFO:teuthology.orchestra.run.smithi066.stdout:Priority: optional 2024-09-17T10:47:24.813 INFO:teuthology.orchestra.run.smithi066.stdout:Section: kernel 2024-09-17T10:47:24.813 INFO:teuthology.orchestra.run.smithi066.stdout:Installed-Size: 21 2024-09-17T10:47:24.814 INFO:teuthology.orchestra.run.smithi066.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T10:47:24.814 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: amd64 2024-09-17T10:47:24.814 INFO:teuthology.orchestra.run.smithi066.stdout:Source: linux-meta 2024-09-17T10:47:24.814 INFO:teuthology.orchestra.run.smithi066.stdout:Version: 5.15.0.122.122 2024-09-17T10:47:24.814 INFO:teuthology.orchestra.run.smithi066.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T10:47:24.814 INFO:teuthology.orchestra.run.smithi066.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T10:47:24.814 INFO:teuthology.orchestra.run.smithi066.stdout:Recommends: thermald 2024-09-17T10:47:24.814 INFO:teuthology.orchestra.run.smithi066.stdout:Description: Generic Linux kernel image 2024-09-17T10:47:24.814 INFO:teuthology.orchestra.run.smithi066.stdout: This package will always depend on the latest generic kernel image 2024-09-17T10:47:24.814 INFO:teuthology.orchestra.run.smithi066.stdout: available. 2024-09-17T10:47:24.814 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T10:47:24.815 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T10:47:24.815 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T10:47:24.815 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-17T10:47:24.815 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi066.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T10:47:24.815 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get clean 2024-09-17T10:47:25.012 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get update 2024-09-17T10:47:25.253 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T10:47:25.254 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T10:47:25.327 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T10:47:25.409 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T10:47:26.135 INFO:teuthology.orchestra.run.smithi161.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T10:47:26.135 INFO:teuthology.orchestra.run.smithi161.stdout:Sourcing file `/etc/default/grub' 2024-09-17T10:47:26.153 INFO:teuthology.orchestra.run.smithi161.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T10:47:26.185 INFO:teuthology.orchestra.run.smithi161.stdout:Generating grub configuration file ... 2024-09-17T10:47:26.455 INFO:teuthology.orchestra.run.smithi161.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T10:47:26.468 INFO:teuthology.orchestra.run.smithi161.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T10:47:26.693 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-09-17T10:47:26.713 DEBUG:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T10:47:26.775 INFO:teuthology.orchestra.run.smithi161.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T10:47:26.777 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-09-17T10:47:26.780 INFO:teuthology.orchestra.run.smithi161.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T10:47:26.851 INFO:teuthology.orchestra.run.smithi161.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T10:47:26.856 INFO:teuthology.orchestra.run.smithi161.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T10:47:26.992 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2024-09-17T10:47:26.993 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2024-09-17T10:47:27.021 INFO:teuthology.orchestra.run.smithi161.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T10:47:27.021 INFO:teuthology.orchestra.run.smithi161.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T10:47:27.021 INFO:teuthology.orchestra.run.smithi161.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T10:47:27.069 INFO:teuthology.orchestra.run.smithi161.stdout:done 2024-09-17T10:47:27.193 INFO:teuthology.orchestra.run.smithi066.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T10:47:27.193 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T10:47:27.193 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T10:47:27.193 INFO:teuthology.orchestra.run.smithi066.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T10:47:27.194 INFO:teuthology.orchestra.run.smithi066.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T10:47:27.194 INFO:teuthology.orchestra.run.smithi066.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T10:47:27.194 INFO:teuthology.orchestra.run.smithi066.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T10:47:27.194 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T10:47:27.240 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T10:47:27.242 DEBUG:teuthology.orchestra.run.smithi066:> dpkg -s linux-image-generic 2024-09-17T10:47:27.258 INFO:teuthology.orchestra.run.smithi066.stdout:Package: linux-image-generic 2024-09-17T10:47:27.258 INFO:teuthology.orchestra.run.smithi066.stdout:Status: install ok installed 2024-09-17T10:47:27.258 INFO:teuthology.orchestra.run.smithi066.stdout:Priority: optional 2024-09-17T10:47:27.258 INFO:teuthology.orchestra.run.smithi066.stdout:Section: kernel 2024-09-17T10:47:27.258 INFO:teuthology.orchestra.run.smithi066.stdout:Installed-Size: 21 2024-09-17T10:47:27.258 INFO:teuthology.orchestra.run.smithi066.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T10:47:27.258 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: amd64 2024-09-17T10:47:27.258 INFO:teuthology.orchestra.run.smithi066.stdout:Source: linux-meta 2024-09-17T10:47:27.258 INFO:teuthology.orchestra.run.smithi066.stdout:Version: 5.15.0.122.122 2024-09-17T10:47:27.258 INFO:teuthology.orchestra.run.smithi066.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T10:47:27.259 INFO:teuthology.orchestra.run.smithi066.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T10:47:27.259 INFO:teuthology.orchestra.run.smithi066.stdout:Recommends: thermald 2024-09-17T10:47:27.259 INFO:teuthology.orchestra.run.smithi066.stdout:Description: Generic Linux kernel image 2024-09-17T10:47:27.259 INFO:teuthology.orchestra.run.smithi066.stdout: This package will always depend on the latest generic kernel image 2024-09-17T10:47:27.259 INFO:teuthology.orchestra.run.smithi066.stdout: available. 2024-09-17T10:47:27.259 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2024-09-17T10:47:27.306 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.C1wEYnEAWP 2024-09-17T10:47:27.306 DEBUG:teuthology.orchestra.run.smithi066:> sudo cp /boot/grub/grub.cfg /tmp/tmp.C1wEYnEAWP 2024-09-17T10:47:27.360 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.C1wEYnEAWP 2024-09-17T10:47:27.484 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.C1wEYnEAWP is 10KB 2024-09-17T10:47:27.497 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.C1wEYnEAWP 2024-09-17T10:47:27.503 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T10:47:27.556 DEBUG:teuthology.orchestra.run.smithi161:> dpkg -s linux-image-generic 2024-09-17T10:47:27.558 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-17T10:47:27.559 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T10:47:27.559 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T10:47:27.584 INFO:teuthology.orchestra.run.smithi161.stdout:Package: linux-image-generic 2024-09-17T10:47:27.584 INFO:teuthology.orchestra.run.smithi161.stdout:Status: install ok installed 2024-09-17T10:47:27.584 INFO:teuthology.orchestra.run.smithi161.stdout:Priority: optional 2024-09-17T10:47:27.584 INFO:teuthology.orchestra.run.smithi161.stdout:Section: kernel 2024-09-17T10:47:27.585 INFO:teuthology.orchestra.run.smithi161.stdout:Installed-Size: 21 2024-09-17T10:47:27.585 INFO:teuthology.orchestra.run.smithi161.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T10:47:27.585 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: amd64 2024-09-17T10:47:27.585 INFO:teuthology.orchestra.run.smithi161.stdout:Source: linux-meta 2024-09-17T10:47:27.585 INFO:teuthology.orchestra.run.smithi161.stdout:Version: 5.15.0.122.122 2024-09-17T10:47:27.585 INFO:teuthology.orchestra.run.smithi161.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T10:47:27.585 INFO:teuthology.orchestra.run.smithi161.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T10:47:27.585 INFO:teuthology.orchestra.run.smithi161.stdout:Recommends: thermald 2024-09-17T10:47:27.585 INFO:teuthology.orchestra.run.smithi161.stdout:Description: Generic Linux kernel image 2024-09-17T10:47:27.585 INFO:teuthology.orchestra.run.smithi161.stdout: This package will always depend on the latest generic kernel image 2024-09-17T10:47:27.586 INFO:teuthology.orchestra.run.smithi161.stdout: available. 2024-09-17T10:47:27.586 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T10:47:27.586 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T10:47:27.586 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T10:47:27.586 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-17T10:47:27.586 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T10:47:27.586 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get clean 2024-09-17T10:47:27.626 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T10:47:27.626 DEBUG:teuthology.orchestra.run.smithi066:> sudo update-grub 2024-09-17T10:47:27.720 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2024-09-17T10:47:27.970 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T10:47:27.971 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T10:47:28.041 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T10:47:28.123 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T10:47:28.874 INFO:teuthology.orchestra.run.smithi066.stderr:Sourcing file `/etc/default/grub' 2024-09-17T10:47:28.874 INFO:teuthology.orchestra.run.smithi066.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T10:47:28.877 INFO:teuthology.orchestra.run.smithi066.stderr:Generating grub configuration file ... 2024-09-17T10:47:29.057 INFO:teuthology.orchestra.run.smithi066.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T10:47:29.064 INFO:teuthology.orchestra.run.smithi066.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T10:47:29.351 INFO:teuthology.orchestra.run.smithi066.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T10:47:29.357 INFO:teuthology.orchestra.run.smithi066.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T10:47:29.388 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-17T10:47:29.397 INFO:teuthology.orchestra.run.smithi066.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T10:47:29.404 INFO:teuthology.orchestra.run.smithi066.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T10:47:29.406 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T10:47:29.469 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-17T10:47:29.524 INFO:teuthology.orchestra.run.smithi066.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T10:47:29.524 INFO:teuthology.orchestra.run.smithi066.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T10:47:29.524 INFO:teuthology.orchestra.run.smithi066.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T10:47:29.534 INFO:teuthology.orchestra.run.smithi066.stderr:done 2024-09-17T10:47:29.537 DEBUG:teuthology.orchestra.run.smithi066:> sudo shutdown -r now 2024-09-17T10:47:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-09-17T10:47:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-09-17T10:47:29.873 INFO:teuthology.orchestra.run.smithi161.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T10:47:29.874 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T10:47:29.874 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T10:47:29.874 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T10:47:29.874 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T10:47:29.874 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T10:47:29.874 INFO:teuthology.orchestra.run.smithi161.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T10:47:29.875 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T10:47:29.913 INFO:teuthology.orchestra.run.smithi161.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T10:47:29.915 DEBUG:teuthology.orchestra.run.smithi161:> dpkg -s linux-image-generic 2024-09-17T10:47:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:Package: linux-image-generic 2024-09-17T10:47:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:Status: install ok installed 2024-09-17T10:47:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:Priority: optional 2024-09-17T10:47:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:Section: kernel 2024-09-17T10:47:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:Installed-Size: 21 2024-09-17T10:47:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T10:47:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: amd64 2024-09-17T10:47:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:Source: linux-meta 2024-09-17T10:47:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:Version: 5.15.0.122.122 2024-09-17T10:47:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T10:47:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T10:47:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:Recommends: thermald 2024-09-17T10:47:29.928 INFO:teuthology.orchestra.run.smithi161.stdout:Description: Generic Linux kernel image 2024-09-17T10:47:29.928 INFO:teuthology.orchestra.run.smithi161.stdout: This package will always depend on the latest generic kernel image 2024-09-17T10:47:29.928 INFO:teuthology.orchestra.run.smithi161.stdout: available. 2024-09-17T10:47:29.928 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-09-17T10:47:29.975 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.kBRkn2FPCq 2024-09-17T10:47:29.975 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub/grub.cfg /tmp/tmp.kBRkn2FPCq 2024-09-17T10:47:30.030 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.kBRkn2FPCq 2024-09-17T10:47:30.155 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.kBRkn2FPCq is 10KB 2024-09-17T10:47:30.167 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.kBRkn2FPCq 2024-09-17T10:47:30.172 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T10:47:30.227 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-17T10:47:30.227 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T10:47:30.227 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T10:47:30.293 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T10:47:30.293 DEBUG:teuthology.orchestra.run.smithi161:> sudo update-grub 2024-09-17T10:47:31.586 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub' 2024-09-17T10:47:31.587 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T10:47:31.589 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2024-09-17T10:47:31.768 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T10:47:31.774 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T10:47:31.998 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T10:47:32.003 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T10:47:32.044 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T10:47:32.049 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T10:47:32.167 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T10:47:32.167 INFO:teuthology.orchestra.run.smithi161.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T10:47:32.168 INFO:teuthology.orchestra.run.smithi161.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T10:47:32.194 INFO:teuthology.orchestra.run.smithi161.stderr:done 2024-09-17T10:47:32.209 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2024-09-17T10:47:59.565 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-17T10:47:59.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-17T10:47:59.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T10:48:02.213 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-17T10:48:02.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-17T10:48:02.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T10:48:34.110 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-09-17T10:48:36.673 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-09-17T10:48:43.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-17T10:48:43.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T10:48:45.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-17T10:48:45.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T10:48:46.177 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-09-17T10:48:58.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-17T10:48:58.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T10:49:04.061 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-09-17T10:49:16.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-17T10:49:16.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T10:49:16.080 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-09-17T10:49:31.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-17T10:49:31.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T10:49:31.344 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-09-17T10:49:31.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-17T10:49:31.902 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.15.0-122-generic"... 2024-09-17T10:49:31.902 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-09-17T10:49:31.948 INFO:teuthology.orchestra.run.smithi161.stdout:5.15.0-122-generic 2024-09-17T10:49:31.948 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T10:49:31.948 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T10:49:31.948 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T10:49:32.949 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-17T10:49:32.950 DEBUG:teuthology.orchestra.run.smithi161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T10:49:33.329 INFO:teuthology.orchestra.run.smithi161.stdout:ttyS1 2024-09-17T10:49:33.346 DEBUG:teuthology.parallel:result is None 2024-09-17T10:49:58.193 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T10:50:13.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-17T10:50:13.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T10:50:13.435 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-09-17T10:50:14.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-17T10:50:14.164 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.15.0-122-generic"... 2024-09-17T10:50:14.164 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-09-17T10:50:14.212 INFO:teuthology.orchestra.run.smithi066.stdout:5.15.0-122-generic 2024-09-17T10:50:14.212 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T10:50:14.212 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T10:50:14.212 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T10:50:15.213 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-17T10:50:15.213 DEBUG:teuthology.orchestra.run.smithi066:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T10:50:15.296 INFO:teuthology.orchestra.run.smithi066.stdout:ttyS1 2024-09-17T10:50:15.318 DEBUG:teuthology.parallel:result is None 2024-09-17T10:50:15.318 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T10:50:15.325 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T10:50:15.325 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T10:50:15.328 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T10:50:15.335 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T10:50:15.349 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T10:50:15.359 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T10:50:15.359 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T10:50:15.377 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T10:50:15.441 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T10:50:15.448 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T10:50:15.448 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T10:50:15.450 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T10:50:15.471 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T10:50:15.474 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T10:50:15.480 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T10:50:15.483 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T10:50:15.484 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T10:50:15.491 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T10:50:15.491 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T10:50:15.525 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T10:50:15.558 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T10:50:15.567 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T10:50:15.568 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T10:50:15.580 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T10:50:15.607 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T10:50:15.632 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T10:50:15.680 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-17T10:50:15.681 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T10:50:15.745 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T10:50:15.751 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T10:50:15.800 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-17T10:50:15.800 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T10:50:15.858 DEBUG:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2024-09-17T10:50:15.860 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2024-09-17T10:50:15.933 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T10:50:15.940 INFO:teuthology.task.internal:Starting timer... 2024-09-17T10:50:15.940 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T10:50:15.950 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T10:50:15.958 DEBUG:teuthology.task.selinux:Excluding smithi066: OS 'ubuntu' does not support SELinux 2024-09-17T10:50:15.958 DEBUG:teuthology.task.selinux:Excluding smithi161: OS 'ubuntu' does not support SELinux 2024-09-17T10:50:15.958 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T10:50:15.958 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-17T10:50:15.958 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T10:50:15.959 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T10:50:15.967 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T10:50:15.988 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T10:50:15.989 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi066.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T10:57:49.387 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi066.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2024-09-17T10:57:49.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-17T10:57:49.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T10:57:49.476 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-09-17T10:57:49.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-17T10:57:49.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-17T10:57:49.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T10:57:49.639 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-09-17T10:57:49.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-17T10:57:49.713 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T10:57:49.724 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T10:57:49.724 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T10:57:49.725 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T10:57:49.727 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T10:57:49.728 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T10:57:49.753 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T10:57:49.753 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: Command line: ntpd -gq 2024-09-17T10:57:49.754 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: ---------------------------------------------------- 2024-09-17T10:57:49.754 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T10:57:49.754 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T10:57:49.754 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: corporation. Support and training for ntp-4 are 2024-09-17T10:57:49.754 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: available at https://www.nwtime.org/support 2024-09-17T10:57:49.754 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: ---------------------------------------------------- 2024-09-17T10:57:49.755 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: proto: precision = 0.046 usec (-24) 2024-09-17T10:57:49.755 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: basedate set to 2022-02-04 2024-09-17T10:57:49.755 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: gps base set to 2022-02-06 (week 2196) 2024-09-17T10:57:49.755 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T10:57:49.755 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T10:57:49.755 INFO:teuthology.orchestra.run.smithi066.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T10:57:49.755 INFO:teuthology.orchestra.run.smithi066.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T10:57:49.756 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T10:57:49.756 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T10:57:49.756 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T10:57:49.757 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: Listen normally on 3 enp3s0f1 172.21.15.66:123 2024-09-17T10:57:49.757 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: Listen normally on 4 lo [::1]:123 2024-09-17T10:57:49.757 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:f8bd%5]:123 2024-09-17T10:57:49.757 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:49 ntpd[18506]: Listening on routing socket on fd #22 for interface updates 2024-09-17T10:57:49.784 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T10:57:49.785 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: Command line: ntpd -gq 2024-09-17T10:57:49.785 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: ---------------------------------------------------- 2024-09-17T10:57:49.785 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T10:57:49.785 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T10:57:49.785 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: corporation. Support and training for ntp-4 are 2024-09-17T10:57:49.785 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: available at https://www.nwtime.org/support 2024-09-17T10:57:49.785 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: ---------------------------------------------------- 2024-09-17T10:57:49.786 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: proto: precision = 0.060 usec (-24) 2024-09-17T10:57:49.786 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: basedate set to 2022-02-04 2024-09-17T10:57:49.786 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: gps base set to 2022-02-06 (week 2196) 2024-09-17T10:57:49.786 INFO:teuthology.orchestra.run.smithi161.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T10:57:49.786 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T10:57:49.787 INFO:teuthology.orchestra.run.smithi161.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T10:57:49.788 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T10:57:49.788 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T10:57:49.788 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T10:57:49.788 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T10:57:49.788 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: Listen normally on 3 enp3s0f1 172.21.15.161:123 2024-09-17T10:57:49.788 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: Listen normally on 4 lo [::1]:123 2024-09-17T10:57:49.788 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7251%5]:123 2024-09-17T10:57:49.788 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:49 ntpd[18570]: Listening on routing socket on fd #22 for interface updates 2024-09-17T10:57:50.754 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:50 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:50.754 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:50 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:51.754 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:51 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:51.754 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:51 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:51.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:51 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:51.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:51 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:51.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:51 ntpd[18506]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:51.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:51 ntpd[18506]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:51 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:51 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:51 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:51 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:51 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:51 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:51 ntpd[18570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:51 ntpd[18570]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:51 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:51 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:51 ntpd[18570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:51 ntpd[18570]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:52.754 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:52 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:52.754 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:52 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:52.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:52 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:52.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:52 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:52.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:52 ntpd[18506]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:52.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:52 ntpd[18506]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:53.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:53 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:53.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:53 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:53.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:53 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:53.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:53 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:53.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:53 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:53.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:53 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:53.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:53 ntpd[18506]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:53.756 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:53 ntpd[18506]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:53.756 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:53 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:53.756 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:53 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:53.756 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:53 ntpd[18506]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:53.756 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:53 ntpd[18506]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:53.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:53 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:53.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:53 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:53.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:53 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:53.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:53 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:53.787 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:53 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:53.787 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:53 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:53.787 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:53 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:53.787 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:53 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:53.787 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:53 ntpd[18570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:53.787 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:53 ntpd[18570]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:53.787 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:53 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:53.787 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:53 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:53.787 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:53 ntpd[18570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:53.787 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:53 ntpd[18570]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:54.754 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:54 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:54.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:54 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:54.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:54 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:54.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:54 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:54.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:54 ntpd[18506]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:54.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:54 ntpd[18506]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:54.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:54 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:54.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:54 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:54.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:54 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:54.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:54 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:54.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:54 ntpd[18570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:54.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:54 ntpd[18570]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:55.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:55 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:55.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:55 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:55.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:55 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:55.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:55 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:55.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:55 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:55.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:55 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:55.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:55 ntpd[18506]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:55.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:55 ntpd[18506]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:55.756 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:55 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:55.756 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:55 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:55.756 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:55 ntpd[18506]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:55.756 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:55 ntpd[18506]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:55.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:55 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:55.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:55 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:55.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:55 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:55.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:55 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:55.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:55 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:55.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:55 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:55.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:55 ntpd[18570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:55.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:55 ntpd[18570]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:55.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:55 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:55.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:55 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:55.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:55 ntpd[18570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:55.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:55 ntpd[18570]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:56.754 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:56 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:56.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:56 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:56.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:56 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:56.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:56 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:56.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:56 ntpd[18506]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:56.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:56 ntpd[18506]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:56.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:56 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:56.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:56 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:56.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:56 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:56.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:56 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:56.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:56 ntpd[18570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:56.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:56 ntpd[18570]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:57.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:57 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:57.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:57 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:57.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:57 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:57.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:57 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:57.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:57 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:57.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:57 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:57.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:57 ntpd[18506]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:57.755 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:57 ntpd[18506]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:57.756 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:57 ntpd[18506]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:57.756 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:57 ntpd[18506]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:57.756 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:57 ntpd[18506]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:57.756 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:57 ntpd[18506]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:57.756 INFO:teuthology.orchestra.run.smithi066.stdout:17 Sep 10:57:57 ntpd[18506]: ntpd: time slew +0.000756 s 2024-09-17T10:57:57.756 INFO:teuthology.orchestra.run.smithi066.stdout:ntpd: time slew +0.000756s 2024-09-17T10:57:57.757 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:57 ntpd[18506]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T10:57:57.757 INFO:teuthology.orchestra.run.smithi066.stderr:17 Sep 10:57:57 ntpd[18506]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T10:57:57.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:57 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:57.785 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:57 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:57.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:57 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:57.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:57 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:57.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:57 ntpd[18570]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T10:57:57.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:57 ntpd[18570]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T10:57:57.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:57 ntpd[18570]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T10:57:57.786 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:57 ntpd[18570]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T10:57:57.786 INFO:teuthology.orchestra.run.smithi161.stdout:17 Sep 10:57:57 ntpd[18570]: ntpd: time slew -0.001787 s 2024-09-17T10:57:57.786 INFO:teuthology.orchestra.run.smithi161.stdout:ntpd: time slew -0.001787s 2024-09-17T10:57:57.787 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:57 ntpd[18570]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T10:57:57.787 INFO:teuthology.orchestra.run.smithi161.stderr:17 Sep 10:57:57 ntpd[18570]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T10:57:57.803 INFO:teuthology.orchestra.run.smithi066.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T10:57:57.803 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================== 2024-09-17T10:57:57.803 INFO:teuthology.orchestra.run.smithi066.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T10:57:57.803 INFO:teuthology.orchestra.run.smithi066.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T10:57:57.803 INFO:teuthology.orchestra.run.smithi066.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T10:57:57.803 INFO:teuthology.orchestra.run.smithi066.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T10:57:57.832 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T10:57:57.832 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2024-09-17T10:57:57.832 INFO:teuthology.orchestra.run.smithi161.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T10:57:57.832 INFO:teuthology.orchestra.run.smithi161.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T10:57:57.832 INFO:teuthology.orchestra.run.smithi161.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T10:57:57.832 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T10:57:57.833 INFO:teuthology.run_tasks:Running task cephadm.configure_samba_client_container... 2024-09-17T10:57:57.930 INFO:tasks.cephadm:Testing if podman is available 2024-09-17T10:57:57.930 DEBUG:teuthology.orchestra.run.smithi161:> sudo podman --help 2024-09-17T10:57:57.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T10:57:57.941 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: podman: command not found 2024-09-17T10:57:57.941 INFO:tasks.cephadm:Failed to find podman. Using docker 2024-09-17T10:57:57.942 DEBUG:teuthology.orchestra.run.smithi161:> sudo docker pull quay.io/samba.org/samba-client:latest 2024-09-17T10:57:58.615 INFO:teuthology.orchestra.run.smithi161.stdout:latest: Pulling from samba.org/samba-client 2024-09-17T10:57:58.616 INFO:teuthology.orchestra.run.smithi161.stdout:76987b461ffc: Pulling fs layer 2024-09-17T10:57:58.616 INFO:teuthology.orchestra.run.smithi161.stdout:86329370b687: Pulling fs layer 2024-09-17T10:57:59.767 INFO:teuthology.orchestra.run.smithi161.stdout:86329370b687: Verifying Checksum 2024-09-17T10:57:59.768 INFO:teuthology.orchestra.run.smithi161.stdout:86329370b687: Download complete 2024-09-17T10:58:00.221 INFO:teuthology.orchestra.run.smithi161.stdout:76987b461ffc: Verifying Checksum 2024-09-17T10:58:00.221 INFO:teuthology.orchestra.run.smithi161.stdout:76987b461ffc: Download complete 2024-09-17T10:58:05.715 INFO:teuthology.orchestra.run.smithi161.stdout:76987b461ffc: Pull complete 2024-09-17T10:58:08.678 INFO:teuthology.orchestra.run.smithi161.stdout:86329370b687: Pull complete 2024-09-17T10:58:08.779 INFO:teuthology.orchestra.run.smithi161.stdout:Digest: sha256:e91c9ad9a0428b3524a5ccf9c1fe6bcd1e8ef8b3d62ac22556a770e32ab3b96a 2024-09-17T10:58:08.829 INFO:teuthology.orchestra.run.smithi161.stdout:Status: Downloaded newer image for quay.io/samba.org/samba-client:latest 2024-09-17T10:58:08.855 INFO:teuthology.orchestra.run.smithi161.stdout:quay.io/samba.org/samba-client:latest 2024-09-17T10:58:08.858 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-17T10:58:08.867 INFO:tasks.cephadm:Config: {'single_host_defaults': True, 'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-only-match': ['CEPHADM_'], 'sha1': '7498493279982dfe87f00616198a5967475f6169'} 2024-09-17T10:58:08.868 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 2024-09-17T10:58:08.868 INFO:tasks.cephadm:Cluster fsid is b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:58:08.868 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-17T10:58:08.869 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.66'} 2024-09-17T10:58:08.869 INFO:tasks.cephadm:First mon is mon.a on smithi066 2024-09-17T10:58:08.869 INFO:tasks.cephadm:First mgr is x 2024-09-17T10:58:08.869 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-17T10:58:08.869 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname $(hostname -s) 2024-09-17T10:58:08.885 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname $(hostname -s) 2024-09-17T10:58:08.900 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-17T10:58:08.900 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7498493279982dfe87f00616198a5967475f6169 2024-09-17T10:58:09.046 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '7498493279982dfe87f00616198a5967475f6169', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic/56090/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4937-g74984932', 'node_name': '172.21.5.38+adami08', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4937-g74984932-1jammy'}, 'url': 'https://1.chacra.ceph.com/r/ceph/main/7498493279982dfe87f00616198a5967475f6169/ubuntu/jammy/flavors/default/', 'distro_codename': 'jammy', 'modified': '2024-09-15 21:50:36.788593', 'distro_version': '22.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'main', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/main/7498493279982dfe87f00616198a5967475f6169/ubuntu/jammy/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}] 2024-09-17T10:58:09.186 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref main, sha1 7498493279982dfe87f00616198a5967475f6169 from https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu%2F22.04%2Fx86_64&flavor=default&sha1=7498493279982dfe87f00616198a5967475f6169 2024-09-17T10:58:09.188 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/main/7498493279982dfe87f00616198a5967475f6169/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-17T10:58:09.188 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/main/7498493279982dfe87f00616198a5967475f6169/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-17T10:58:09.188 DEBUG:teuthology.orchestra.run.smithi066:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/main/7498493279982dfe87f00616198a5967475f6169/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T10:58:09.651 INFO:teuthology.orchestra.run.smithi066.stdout:-rw-rw-r-- 1 ubuntu ubuntu 811925 Sep 17 10:58 /home/ubuntu/cephtest/cephadm 2024-09-17T10:58:09.652 DEBUG:teuthology.orchestra.run.smithi161:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/main/7498493279982dfe87f00616198a5967475f6169/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T10:58:10.334 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-rw-r-- 1 ubuntu ubuntu 811925 Sep 17 10:58 /home/ubuntu/cephtest/cephadm 2024-09-17T10:58:10.334 DEBUG:teuthology.orchestra.run.smithi066:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T10:58:10.341 DEBUG:teuthology.orchestra.run.smithi161:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T10:58:10.358 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 on all hosts... 2024-09-17T10:58:10.358 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 pull 2024-09-17T10:58:10.385 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 pull 2024-09-17T10:58:10.572 INFO:teuthology.orchestra.run.smithi161.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169... 2024-09-17T10:58:10.573 INFO:teuthology.orchestra.run.smithi066.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169... 2024-09-17T10:59:10.353 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-17T10:59:10.354 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_version": "ceph version 19.3.0-4937-g74984932 (7498493279982dfe87f00616198a5967475f6169) squid (dev)", 2024-09-17T10:59:10.354 INFO:teuthology.orchestra.run.smithi066.stdout: "image_id": "6c1fcab85602ba9d6ddde3c89adee6ee0382b7527a8ed3ee372c969068775c76", 2024-09-17T10:59:10.354 INFO:teuthology.orchestra.run.smithi066.stdout: "repo_digests": [ 2024-09-17T10:59:10.354 INFO:teuthology.orchestra.run.smithi066.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d1ee255599fffe6c832aeedeed0b06c298863896564017e014e180f38b9ae1bb" 2024-09-17T10:59:10.354 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-17T10:59:10.354 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-17T10:59:13.427 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-17T10:59:13.428 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 19.3.0-4937-g74984932 (7498493279982dfe87f00616198a5967475f6169) squid (dev)", 2024-09-17T10:59:13.428 INFO:teuthology.orchestra.run.smithi161.stdout: "image_id": "6c1fcab85602ba9d6ddde3c89adee6ee0382b7527a8ed3ee372c969068775c76", 2024-09-17T10:59:13.428 INFO:teuthology.orchestra.run.smithi161.stdout: "repo_digests": [ 2024-09-17T10:59:13.428 INFO:teuthology.orchestra.run.smithi161.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d1ee255599fffe6c832aeedeed0b06c298863896564017e014e180f38b9ae1bb" 2024-09-17T10:59:13.428 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-17T10:59:13.428 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-17T10:59:13.472 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph 2024-09-17T10:59:13.487 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph 2024-09-17T10:59:13.502 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 777 /etc/ceph 2024-09-17T10:59:13.543 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /etc/ceph 2024-09-17T10:59:13.556 INFO:tasks.cephadm:Writing seed config... 2024-09-17T10:59:13.557 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-17T10:59:13.557 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-17T10:59:13.557 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-17T10:59:13.558 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-17T10:59:13.558 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-17T10:59:13.558 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-17T10:59:13.558 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-17T10:59:13.558 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-17T10:59:13.559 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-17T10:59:13.593 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = b966aac8-74e3-11ef-bceb-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-17T10:59:13.593 DEBUG:teuthology.orchestra.run.smithi066:mon.a> sudo journalctl -f -n 0 -u ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mon.a.service 2024-09-17T10:59:13.637 DEBUG:teuthology.orchestra.run.smithi066:mgr.x> sudo journalctl -f -n 0 -u ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mgr.x.service 2024-09-17T10:59:13.680 INFO:tasks.cephadm:Bootstrapping... 2024-09-17T10:59:13.681 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 -v bootstrap --fsid b966aac8-74e3-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.66 --single-host-defaults --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-17T10:59:13.911 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-17T10:59:13.911 INFO:teuthology.orchestra.run.smithi066.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169', '-v', 'bootstrap', '--fsid', 'b966aac8-74e3-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.66', '--single-host-defaults', '--skip-admin-label'] 2024-09-17T10:59:13.912 INFO:teuthology.orchestra.run.smithi066.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-17T10:59:13.912 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying podman|docker is present... 2024-09-17T10:59:13.912 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying lvm2 is present... 2024-09-17T10:59:13.912 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying time synchronization is in place... 2024-09-17T10:59:13.917 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T10:59:13.917 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T10:59:13.921 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T10:59:13.922 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-17T10:59:13.926 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-17T10:59:13.926 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-17T10:59:13.929 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-17T10:59:13.930 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-17T10:59:13.933 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-17T10:59:13.933 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout masked 2024-09-17T10:59:13.937 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-17T10:59:13.937 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-17T10:59:13.941 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-17T10:59:13.941 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-17T10:59:13.944 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-17T10:59:13.945 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-17T10:59:13.949 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout enabled 2024-09-17T10:59:13.953 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout active 2024-09-17T10:59:13.953 INFO:teuthology.orchestra.run.smithi066.stdout:Unit ntp.service is enabled and running 2024-09-17T10:59:13.953 INFO:teuthology.orchestra.run.smithi066.stdout:Repeating the final host check... 2024-09-17T10:59:13.953 INFO:teuthology.orchestra.run.smithi066.stdout:docker (/usr/bin/docker) is present 2024-09-17T10:59:13.953 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl is present 2024-09-17T10:59:13.953 INFO:teuthology.orchestra.run.smithi066.stdout:lvcreate is present 2024-09-17T10:59:13.956 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T10:59:13.957 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T10:59:13.960 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T10:59:13.960 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-17T10:59:13.963 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-17T10:59:13.963 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-17T10:59:13.968 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-17T10:59:13.968 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-17T10:59:13.972 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-17T10:59:13.972 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout masked 2024-09-17T10:59:13.976 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-17T10:59:13.976 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-17T10:59:13.979 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-17T10:59:13.979 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-17T10:59:13.982 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-17T10:59:13.983 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-17T10:59:13.987 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout enabled 2024-09-17T10:59:13.991 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout active 2024-09-17T10:59:13.991 INFO:teuthology.orchestra.run.smithi066.stdout:Unit ntp.service is enabled and running 2024-09-17T10:59:13.991 INFO:teuthology.orchestra.run.smithi066.stdout:Host looks OK 2024-09-17T10:59:13.991 INFO:teuthology.orchestra.run.smithi066.stdout:Cluster fsid: b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:59:13.991 INFO:teuthology.orchestra.run.smithi066.stdout:Acquiring lock 140144692919216 on /run/cephadm/b966aac8-74e3-11ef-bceb-c7b262605968.lock 2024-09-17T10:59:13.992 INFO:teuthology.orchestra.run.smithi066.stdout:Lock 140144692919216 acquired on /run/cephadm/b966aac8-74e3-11ef-bceb-c7b262605968.lock 2024-09-17T10:59:13.992 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying IP 172.21.15.66 port 3300 ... 2024-09-17T10:59:13.992 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying IP 172.21.15.66 port 6789 ... 2024-09-17T10:59:13.992 INFO:teuthology.orchestra.run.smithi066.stdout:Base mon IP(s) is [172.21.15.66:3300, 172.21.15.66:6789], mon addrv is [v2:172.21.15.66:3300,v1:172.21.15.66:6789] 2024-09-17T10:59:13.994 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 2024-09-17T10:59:13.995 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.66 metric 100 2024-09-17T10:59:13.995 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout 158.69.67.47 via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.66 metric 100 2024-09-17T10:59:13.995 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-09-17T10:59:13.995 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.66 metric 100 2024-09-17T10:59:13.995 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout 172.21.0.1 dev enp3s0f1 proto dhcp scope link src 172.21.15.66 metric 100 2024-09-17T10:59:13.995 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout 172.21.0.2 dev enp3s0f1 proto dhcp scope link src 172.21.15.66 metric 100 2024-09-17T10:59:13.995 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.66 metric 100 2024-09-17T10:59:13.997 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-17T10:59:13.997 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-09-17T10:59:13.997 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 expires 1796sec pref medium 2024-09-17T10:59:13.999 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-17T10:59:13.999 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-17T10:59:13.999 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T10:59:13.999 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-17T10:59:13.999 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2024-09-17T10:59:13.999 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T10:59:14.000 INFO:teuthology.orchestra.run.smithi066.stdout:Mon IP `172.21.15.66` is in CIDR network `172.21.0.0/20` 2024-09-17T10:59:14.000 INFO:teuthology.orchestra.run.smithi066.stdout:Mon IP `172.21.15.66` is in CIDR network `172.21.0.0/20` 2024-09-17T10:59:14.001 INFO:teuthology.orchestra.run.smithi066.stdout:Mon IP `172.21.15.66` is in CIDR network `172.21.0.1/32` 2024-09-17T10:59:14.001 INFO:teuthology.orchestra.run.smithi066.stdout:Mon IP `172.21.15.66` is in CIDR network `172.21.0.1/32` 2024-09-17T10:59:14.001 INFO:teuthology.orchestra.run.smithi066.stdout:Mon IP `172.21.15.66` is in CIDR network `172.21.0.2/32` 2024-09-17T10:59:14.001 INFO:teuthology.orchestra.run.smithi066.stdout:Mon IP `172.21.15.66` is in CIDR network `172.21.0.2/32` 2024-09-17T10:59:14.001 INFO:teuthology.orchestra.run.smithi066.stdout:Mon IP `172.21.15.66` is in CIDR network `172.21.15.254/32` 2024-09-17T10:59:14.001 INFO:teuthology.orchestra.run.smithi066.stdout:Mon IP `172.21.15.66` is in CIDR network `172.21.15.254/32` 2024-09-17T10:59:14.001 INFO:teuthology.orchestra.run.smithi066.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20', '172.21.0.1/32', '172.21.0.1/32', '172.21.0.2/32', '172.21.0.2/32', '172.21.15.254/32', '172.21.15.254/32'] 2024-09-17T10:59:14.001 INFO:teuthology.orchestra.run.smithi066.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-17T10:59:14.002 INFO:teuthology.orchestra.run.smithi066.stdout:Adjusting default settings to suit single-host cluster... 2024-09-17T10:59:14.002 INFO:teuthology.orchestra.run.smithi066.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169... 2024-09-17T10:59:14.226 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/docker: stdout 7498493279982dfe87f00616198a5967475f6169: Pulling from ceph-ci/ceph 2024-09-17T10:59:14.226 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/docker: stdout Digest: sha256:d1ee255599fffe6c832aeedeed0b06c298863896564017e014e180f38b9ae1bb 2024-09-17T10:59:14.226 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 2024-09-17T10:59:14.227 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 2024-09-17T10:59:15.857 INFO:teuthology.orchestra.run.smithi066.stdout:ceph: stdout ceph version 19.3.0-4937-g74984932 (7498493279982dfe87f00616198a5967475f6169) squid (dev) 2024-09-17T10:59:15.857 INFO:teuthology.orchestra.run.smithi066.stdout:Ceph version: ceph version 19.3.0-4937-g74984932 (7498493279982dfe87f00616198a5967475f6169) squid (dev) 2024-09-17T10:59:15.857 INFO:teuthology.orchestra.run.smithi066.stdout:Extracting ceph user uid/gid from container image... 2024-09-17T10:59:17.249 INFO:teuthology.orchestra.run.smithi066.stdout:stat: stdout 167 167 2024-09-17T10:59:17.249 INFO:teuthology.orchestra.run.smithi066.stdout:Creating initial keys... 2024-09-17T10:59:18.651 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-authtool: stdout AQAGYelmfpX6AhAAfcKFnRgnDU+JKWsxuFfyVQ== 2024-09-17T10:59:20.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-authtool: stdout AQAHYelmZ/lLJRAAgU4UNh1pbW2HPDCU2r9IjA== 2024-09-17T10:59:21.804 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-authtool: stdout AQAJYelmaANCBhAARpR/wAORkyZAL0RNMaP1Hg== 2024-09-17T10:59:21.804 INFO:teuthology.orchestra.run.smithi066.stdout:Creating initial monmap... 2024-09-17T10:59:23.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T10:59:23.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-17T10:59:23.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:59:23.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T10:59:23.278 INFO:teuthology.orchestra.run.smithi066.stdout:monmaptool for a [v2:172.21.15.66:3300,v1:172.21.15.66:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T10:59:23.278 INFO:teuthology.orchestra.run.smithi066.stdout:setting min_mon_release = quincy 2024-09-17T10:59:23.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: set fsid to b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:59:23.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T10:59:23.279 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T10:59:23.279 INFO:teuthology.orchestra.run.smithi066.stdout:Creating mon... 2024-09-17T10:59:24.724 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.197+0000 7f68b3ee0c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-17T10:59:24.725 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.197+0000 7f68b3ee0c80 1 imported monmap: 2024-09-17T10:59:24.725 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-09-17T10:59:24.725 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr fsid b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:59:24.725 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-09-17T10:59:22.724865+0000 2024-09-17T10:59:24.725 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr created 2024-09-17T10:59:22.724865+0000 2024-09-17T10:59:24.727 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr min_mon_release 17 (quincy) 2024-09-17T10:59:24.727 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-09-17T10:59:24.727 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-17T10:59:24.727 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.727 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.197+0000 7f68b3ee0c80 0 /usr/bin/ceph-mon: set fsid to b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:59:24.727 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: RocksDB version: 7.9.2 2024-09-17T10:59:24.727 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.727 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Git sha 0 2024-09-17T10:59:24.727 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Compile date 2024-09-15 20:52:36 2024-09-17T10:59:24.728 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: DB SUMMARY 2024-09-17T10:59:24.728 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.728 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: DB Session ID: 4KWUO3FI1FOJHXEA7DWS 2024-09-17T10:59:24.728 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.728 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-09-17T10:59:24.728 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.730 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-09-17T10:59:24.730 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.730 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.error_if_exists: 0 2024-09-17T10:59:24.730 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.create_if_missing: 1 2024-09-17T10:59:24.730 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.paranoid_checks: 1 2024-09-17T10:59:24.731 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T10:59:24.731 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T10:59:24.731 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T10:59:24.731 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.env: 0x5579dd2cb120 2024-09-17T10:59:24.731 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-17T10:59:24.731 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.info_log: 0x5579deaa8bc0 2024-09-17T10:59:24.731 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-17T10:59:24.731 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.statistics: (nil) 2024-09-17T10:59:24.731 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.use_fsync: 0 2024-09-17T10:59:24.731 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.max_log_file_size: 0 2024-09-17T10:59:24.731 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T10:59:24.731 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T10:59:24.731 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-17T10:59:24.731 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-17T10:59:24.732 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.allow_fallocate: 1 2024-09-17T10:59:24.732 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-17T10:59:24.734 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-17T10:59:24.734 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.use_direct_reads: 0 2024-09-17T10:59:24.734 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T10:59:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-17T10:59:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.db_log_dir: 2024-09-17T10:59:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.wal_dir: 2024-09-17T10:59:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T10:59:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T10:59:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T10:59:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T10:59:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T10:59:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T10:59:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-17T10:59:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-17T10:59:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.write_buffer_manager: 0x5579deaa1cc0 2024-09-17T10:59:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T10:59:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T10:59:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T10:59:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-17T10:59:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T10:59:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-17T10:59:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-17T10:59:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-17T10:59:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.unordered_write: 0 2024-09-17T10:59:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T10:59:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T10:59:24.740 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T10:59:24.740 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T10:59:24.740 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.row_cache: None 2024-09-17T10:59:24.740 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.wal_filter: None 2024-09-17T10:59:24.740 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T10:59:24.740 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-17T10:59:24.740 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.two_write_queues: 0 2024-09-17T10:59:24.740 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-17T10:59:24.740 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.wal_compression: 0 2024-09-17T10:59:24.740 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.atomic_flush: 0 2024-09-17T10:59:24.740 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T10:59:24.741 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T10:59:24.741 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T10:59:24.741 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.log_readahead_size: 0 2024-09-17T10:59:24.741 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T10:59:24.741 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-17T10:59:24.741 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T10:59:24.741 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T10:59:24.741 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-17T10:59:24.741 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-17T10:59:24.741 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T10:59:24.741 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.max_background_jobs: 2 2024-09-17T10:59:24.741 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.max_background_compactions: -1 2024-09-17T10:59:24.742 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.max_subcompactions: 1 2024-09-17T10:59:24.742 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T10:59:24.742 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T10:59:24.742 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T10:59:24.742 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-17T10:59:24.742 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T10:59:24.742 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T10:59:24.742 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T10:59:24.742 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T10:59:24.742 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.max_open_files: -1 2024-09-17T10:59:24.742 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-17T10:59:24.747 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T10:59:24.747 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T10:59:24.747 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-17T10:59:24.747 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Options.max_background_flushes: -1 2024-09-17T10:59:24.747 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Compression algorithms supported: 2024-09-17T10:59:24.747 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: kZSTD supported: 0 2024-09-17T10:59:24.747 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: kXpressCompression supported: 0 2024-09-17T10:59:24.747 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: kBZip2Compression supported: 0 2024-09-17T10:59:24.747 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T10:59:24.747 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: kLZ4Compression supported: 1 2024-09-17T10:59:24.747 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: kZlibCompression supported: 1 2024-09-17T10:59:24.748 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-17T10:59:24.748 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: kSnappyCompression supported: 1 2024-09-17T10:59:24.748 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T10:59:24.748 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T10:59:24.748 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.201+0000 7f68b3ee0c80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-09-17T10:59:24.748 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.748 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-09-17T10:59:24.748 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.748 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T10:59:24.748 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.748 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T10:59:24.748 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.merge_operator: 2024-09-17T10:59:24.749 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compaction_filter: None 2024-09-17T10:59:24.749 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-17T10:59:24.749 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-17T10:59:24.749 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T10:59:24.749 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T10:59:24.749 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5579deaa8820) 2024-09-17T10:59:24.749 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-09-17T10:59:24.749 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T10:59:24.749 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T10:59:24.749 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-09-17T10:59:24.749 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-09-17T10:59:24.749 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-09-17T10:59:24.749 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-09-17T10:59:24.750 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-09-17T10:59:24.750 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-09-17T10:59:24.750 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-09-17T10:59:24.750 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x5579dea91610 2024-09-17T10:59:24.750 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-09-17T10:59:24.750 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-09-17T10:59:24.750 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-09-17T10:59:24.750 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-09-17T10:59:24.755 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-09-17T10:59:24.755 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-09-17T10:59:24.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-09-17T10:59:24.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-09-17T10:59:24.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-09-17T10:59:24.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-09-17T10:59:24.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-09-17T10:59:24.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-09-17T10:59:24.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-09-17T10:59:24.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-09-17T10:59:24.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-09-17T10:59:24.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-09-17T10:59:24.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-09-17T10:59:24.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-09-17T10:59:24.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-09-17T10:59:24.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-09-17T10:59:24.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-09-17T10:59:24.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-09-17T10:59:24.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-09-17T10:59:24.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-09-17T10:59:24.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-09-17T10:59:24.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-09-17T10:59:24.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-17T10:59:24.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-17T10:59:24.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compression: NoCompression 2024-09-17T10:59:24.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-17T10:59:24.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-17T10:59:24.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T10:59:24.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.num_levels: 7 2024-09-17T10:59:24.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T10:59:24.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T10:59:24.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T10:59:24.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T10:59:24.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T10:59:24.759 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T10:59:24.759 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T10:59:24.759 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T10:59:24.759 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T10:59:24.759 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T10:59:24.759 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T10:59:24.759 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T10:59:24.759 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T10:59:24.759 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-17T10:59:24.759 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-17T10:59:24.759 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T10:59:24.759 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T10:59:24.759 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T10:59:24.760 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T10:59:24.760 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-17T10:59:24.760 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T10:59:24.760 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T10:59:24.760 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T10:59:24.760 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T10:59:24.760 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-17T10:59:24.768 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T10:59:24.768 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T10:59:24.768 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T10:59:24.768 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T10:59:24.768 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T10:59:24.768 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T10:59:24.768 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T10:59:24.768 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T10:59:24.768 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T10:59:24.768 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T10:59:24.769 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T10:59:24.769 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T10:59:24.769 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T10:59:24.769 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T10:59:24.769 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-17T10:59:24.769 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T10:59:24.769 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T10:59:24.769 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-17T10:59:24.769 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T10:59:24.769 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T10:59:24.769 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T10:59:24.769 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T10:59:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T10:59:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T10:59:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T10:59:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T10:59:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T10:59:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T10:59:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T10:59:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-17T10:59:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T10:59:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T10:59:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T10:59:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T10:59:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.bloom_locality: 0 2024-09-17T10:59:24.771 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-17T10:59:24.771 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T10:59:24.771 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-17T10:59:24.771 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-17T10:59:24.771 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-17T10:59:24.771 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.ttl: 2592000 2024-09-17T10:59:24.771 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T10:59:24.771 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T10:59:24.771 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T10:59:24.771 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.enable_blob_files: false 2024-09-17T10:59:24.771 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.min_blob_size: 0 2024-09-17T10:59:24.771 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-17T10:59:24.771 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T10:59:24.772 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T10:59:24.772 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T10:59:24.772 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T10:59:24.772 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T10:59:24.772 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-17T10:59:24.772 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T10:59:24.772 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T10:59:24.772 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.772 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-17T10:59:24.772 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.772 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e8182dd8-598b-44bc-8516-659013fa7908 2024-09-17T10:59:24.772 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.772 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.205+0000 7f68b3ee0c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-09-17T10:59:24.773 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.773 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.209+0000 7f68b3ee0c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5579deac0e00 2024-09-17T10:59:24.773 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.209+0000 7f68b3ee0c80 4 rocksdb: DB pointer 0x5579deba2000 2024-09-17T10:59:24.773 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.209+0000 7f68ab66b640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T10:59:24.773 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.209+0000 7f68ab66b640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T10:59:24.773 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-09-17T10:59:24.773 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T10:59:24.773 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T10:59:24.773 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T10:59:24.773 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T10:59:24.773 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T10:59:24.773 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T10:59:24.773 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T10:59:24.774 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.774 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-17T10:59:24.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T10:59:24.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T10:59:24.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T10:59:24.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T10:59:24.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-17T10:59:24.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T10:59:24.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T10:59:24.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T10:59:24.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T10:59:24.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T10:59:24.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T10:59:24.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-09-17T10:59:24.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T10:59:24.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-09-17T10:59:24.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T10:59:24.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T10:59:24.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T10:59:24.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x5579dea91610#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2024-09-17T10:59:24.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-09-17T10:59:24.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-09-17T10:59:24.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr 2024-09-17T10:59:24.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.209+0000 7f68b3ee0c80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-09-17T10:59:24.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.209+0000 7f68b3ee0c80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-09-17T10:59:24.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-17T10:59:24.209+0000 7f68b3ee0c80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-09-17T10:59:24.779 INFO:teuthology.orchestra.run.smithi066.stdout:create mon.a on 2024-09-17T10:59:25.210 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-09-17T10:59:25.431 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-b966aac8-74e3-11ef-bceb-c7b262605968.target -> /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968.target. 2024-09-17T10:59:25.431 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-b966aac8-74e3-11ef-bceb-c7b262605968.target -> /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968.target. 2024-09-17T10:59:25.733 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mon.a 2024-09-17T10:59:25.733 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to reset failed state of unit ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-17T10:59:25.929 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968.target.wants/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mon.a.service -> /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service. 2024-09-17T10:59:25.938 INFO:teuthology.orchestra.run.smithi066.stdout:firewalld does not appear to be present 2024-09-17T10:59:25.938 INFO:teuthology.orchestra.run.smithi066.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T10:59:25.938 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mon to start... 2024-09-17T10:59:25.938 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mon... 2024-09-17T10:59:27.647 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:27 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.445317+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-17T10:59:28.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout cluster: 2024-09-17T10:59:28.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout id: b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:59:28.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-17T10:59:28.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-17T10:59:28.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout services: 2024-09-17T10:59:28.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.186904s) 2024-09-17T10:59:28.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-17T10:59:28.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-17T10:59:28.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-17T10:59:28.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout data: 2024-09-17T10:59:28.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-17T10:59:28.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-17T10:59:28.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-17T10:59:28.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout pgs: 2024-09-17T10:59:28.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-17T10:59:28.198 INFO:teuthology.orchestra.run.smithi066.stdout:mon is available 2024-09-17T10:59:28.198 INFO:teuthology.orchestra.run.smithi066.stdout:Assimilating anything we can from ceph.conf... 2024-09-17T10:59:28.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448487+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-17T10:59:28.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448487+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-17T10:59:28.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448665+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 1 2024-09-17T10:59:28.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448665+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 1 2024-09-17T10:59:28.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448675+0000 mon.a (mon.0) 4 : cluster [DBG] fsid b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:59:28.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448675+0000 mon.a (mon.0) 4 : cluster [DBG] fsid b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:59:28.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448682+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-17T10:59:22.724865+0000 2024-09-17T10:59:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448682+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-17T10:59:22.724865+0000 2024-09-17T10:59:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448690+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-17T10:59:22.724865+0000 2024-09-17T10:59:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448690+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-17T10:59:22.724865+0000 2024-09-17T10:59:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448698+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-17T10:59:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448698+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-17T10:59:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448705+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-17T10:59:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448705+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-17T10:59:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448712+0000 mon.a (mon.0) 9 : cluster [DBG] 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-17T10:59:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.448712+0000 mon.a (mon.0) 9 : cluster [DBG] 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-17T10:59:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.450854+0000 mon.a (mon.0) 10 : cluster [DBG] fsmap 2024-09-17T10:59:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.450854+0000 mon.a (mon.0) 10 : cluster [DBG] fsmap 2024-09-17T10:59:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.453258+0000 mon.a (mon.0) 11 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-17T10:59:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.453258+0000 mon.a (mon.0) 11 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-17T10:59:28.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.453728+0000 mon.a (mon.0) 12 : cluster [DBG] mgrmap e1: no daemons active 2024-09-17T10:59:28.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: cluster 2024-09-17T10:59:27.453728+0000 mon.a (mon.0) 12 : cluster [DBG] mgrmap e1: no daemons active 2024-09-17T10:59:28.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: audit 2024-09-17T10:59:27.635334+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.66:0/2424200328' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-17T10:59:28.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:28 smithi066 bash[19387]: audit 2024-09-17T10:59:27.635334+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.66:0/2424200328' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-17T10:59:29.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:29 smithi066 bash[19387]: audit 2024-09-17T10:59:29.459988+0000 mon.a (mon.0) 14 : audit [INF] from='client.? 172.21.15.66:0/3616091960' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-17T10:59:29.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:29 smithi066 bash[19387]: audit 2024-09-17T10:59:29.459988+0000 mon.a (mon.0) 14 : audit [INF] from='client.? 172.21.15.66:0/3616091960' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-17T10:59:29.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:29 smithi066 bash[19387]: audit 2024-09-17T10:59:29.464260+0000 mon.a (mon.0) 15 : audit [INF] from='client.? 172.21.15.66:0/3616091960' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-17T10:59:29.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:29 smithi066 bash[19387]: audit 2024-09-17T10:59:29.464260+0000 mon.a (mon.0) 15 : audit [INF] from='client.? 172.21.15.66:0/3616091960' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-17T10:59:29.977 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-17T10:59:29.977 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T10:59:29.977 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout fsid = b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:59:29.977 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-17T10:59:29.977 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.66:3300,v1:172.21.15.66:6789] 2024-09-17T10:59:29.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T10:59:29.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T10:59:29.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T10:59:29.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T10:59:29.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-17T10:59:29.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T10:59:29.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T10:59:29.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-17T10:59:29.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T10:59:29.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T10:59:29.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T10:59:29.980 INFO:teuthology.orchestra.run.smithi066.stdout:Generating new minimal ceph.conf... 2024-09-17T10:59:31.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:31 smithi066 bash[19387]: audit 2024-09-17T10:59:31.126267+0000 mon.a (mon.0) 16 : audit [DBG] from='client.? 172.21.15.66:0/944918553' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T10:59:31.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:31 smithi066 bash[19387]: audit 2024-09-17T10:59:31.126267+0000 mon.a (mon.0) 16 : audit [DBG] from='client.? 172.21.15.66:0/944918553' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T10:59:31.667 INFO:teuthology.orchestra.run.smithi066.stdout:Restarting the monitor... 2024-09-17T10:59:31.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:31 smithi066 systemd[1]: Stopping Ceph mon.a for b966aac8-74e3-11ef-bceb-c7b262605968... 2024-09-17T10:59:31.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:31 smithi066 bash[19387]: debug 2024-09-17T10:59:31.785+0000 7f352d630640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-17T10:59:31.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:31 smithi066 bash[19387]: debug 2024-09-17T10:59:31.785+0000 7f352d630640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-17T10:59:32.359 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:32 smithi066 bash[19770]: ceph-b966aac8-74e3-11ef-bceb-c7b262605968-mon-a 2024-09-17T10:59:32.378 INFO:teuthology.orchestra.run.smithi066.stdout:Setting public_network to 172.21.0.2/32,172.21.15.254/32,172.21.0.0/20,172.21.0.1/32 in mon config section 2024-09-17T10:59:32.648 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:32 smithi066 bash[19831]: Error response from daemon: No such container: ceph-b966aac8-74e3-11ef-bceb-c7b262605968-mon-a 2024-09-17T10:59:32.648 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:32 smithi066 systemd[1]: ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-17T10:59:32.648 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:32 smithi066 systemd[1]: Stopped Ceph mon.a for b966aac8-74e3-11ef-bceb-c7b262605968. 2024-09-17T10:59:32.648 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:32 smithi066 systemd[1]: Started Ceph mon.a for b966aac8-74e3-11ef-bceb-c7b262605968. 2024-09-17T10:59:33.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.745+0000 7ff0c3a62c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-17T10:59:33.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.745+0000 7ff0c3a62c80 0 ceph version 19.3.0-4937-g74984932 (7498493279982dfe87f00616198a5967475f6169) squid (dev), process ceph-mon, pid 7 2024-09-17T10:59:33.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.745+0000 7ff0c3a62c80 0 pidfile_write: ignore empty --pid-file 2024-09-17T10:59:33.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 0 load: jerasure load: lrc 2024-09-17T10:59:33.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: RocksDB version: 7.9.2 2024-09-17T10:59:33.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Git sha 0 2024-09-17T10:59:33.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Compile date 2024-09-15 20:52:36 2024-09-17T10:59:33.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: DB SUMMARY 2024-09-17T10:59:33.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: DB Session ID: TF3MQIZDSXD7G5OLEMU8 2024-09-17T10:59:33.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: CURRENT file: CURRENT 2024-09-17T10:59:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-17T10:59:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-17T10:59:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-17T10:59:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 89212 ; 2024-09-17T10:59:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.error_if_exists: 0 2024-09-17T10:59:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.create_if_missing: 0 2024-09-17T10:59:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.paranoid_checks: 1 2024-09-17T10:59:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T10:59:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T10:59:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T10:59:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.env: 0x557b575b9120 2024-09-17T10:59:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-17T10:59:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.info_log: 0x557b59ce3700 2024-09-17T10:59:33.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-17T10:59:33.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.statistics: (nil) 2024-09-17T10:59:33.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.use_fsync: 0 2024-09-17T10:59:33.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_log_file_size: 0 2024-09-17T10:59:33.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T10:59:33.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T10:59:33.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-17T10:59:33.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-17T10:59:33.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.allow_fallocate: 1 2024-09-17T10:59:33.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-17T10:59:33.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-17T10:59:33.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.use_direct_reads: 0 2024-09-17T10:59:33.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T10:59:33.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-17T10:59:33.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.db_log_dir: 2024-09-17T10:59:33.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.wal_dir: 2024-09-17T10:59:33.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T10:59:33.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T10:59:33.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T10:59:33.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T10:59:33.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T10:59:33.963 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T10:59:33.963 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-17T10:59:33.963 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-17T10:59:33.963 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.write_buffer_manager: 0x557b59ce7b80 2024-09-17T10:59:33.963 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T10:59:33.963 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T10:59:33.963 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T10:59:33.964 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-17T10:59:33.964 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T10:59:33.964 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-17T10:59:33.964 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-17T10:59:33.964 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-17T10:59:33.964 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.unordered_write: 0 2024-09-17T10:59:33.965 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T10:59:33.965 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T10:59:33.965 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T10:59:33.965 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T10:59:33.965 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.row_cache: None 2024-09-17T10:59:33.965 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.wal_filter: None 2024-09-17T10:59:33.966 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T10:59:33.966 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-17T10:59:33.966 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.two_write_queues: 0 2024-09-17T10:59:33.966 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-17T10:59:33.966 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.wal_compression: 0 2024-09-17T10:59:33.966 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.atomic_flush: 0 2024-09-17T10:59:33.966 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T10:59:33.967 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T10:59:33.967 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T10:59:33.967 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.log_readahead_size: 0 2024-09-17T10:59:33.967 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T10:59:33.967 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-17T10:59:33.967 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T10:59:33.967 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T10:59:33.968 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-17T10:59:33.968 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-17T10:59:33.968 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T10:59:33.968 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_background_jobs: 2 2024-09-17T10:59:33.968 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_background_compactions: -1 2024-09-17T10:59:33.968 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_subcompactions: 1 2024-09-17T10:59:33.969 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T10:59:33.969 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T10:59:33.969 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T10:59:33.969 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-17T10:59:33.969 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T10:59:33.969 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T10:59:33.969 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T10:59:33.970 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T10:59:33.970 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_open_files: -1 2024-09-17T10:59:33.970 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-17T10:59:33.970 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T10:59:33.970 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T10:59:33.970 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-17T10:59:33.970 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_background_flushes: -1 2024-09-17T10:59:33.971 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Compression algorithms supported: 2024-09-17T10:59:33.971 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: kZSTD supported: 0 2024-09-17T10:59:33.971 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: kXpressCompression supported: 0 2024-09-17T10:59:33.971 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: kBZip2Compression supported: 0 2024-09-17T10:59:33.971 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T10:59:33.971 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: kLZ4Compression supported: 1 2024-09-17T10:59:33.971 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: kZlibCompression supported: 1 2024-09-17T10:59:33.972 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-17T10:59:33.972 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: kSnappyCompression supported: 1 2024-09-17T10:59:33.972 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T10:59:33.972 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T10:59:33.972 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-17T10:59:33.972 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T10:59:33.972 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T10:59:33.973 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.merge_operator: 2024-09-17T10:59:33.973 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compaction_filter: None 2024-09-17T10:59:33.973 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-17T10:59:33.973 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-17T10:59:33.973 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T10:59:33.973 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T10:59:33.974 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557b59ce3320) 2024-09-17T10:59:33.974 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cache_index_and_filter_blocks: 1 2024-09-17T10:59:33.974 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T10:59:33.974 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T10:59:33.974 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: pin_top_level_index_and_filter: 1 2024-09-17T10:59:33.974 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: index_type: 0 2024-09-17T10:59:33.974 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: data_block_index_type: 0 2024-09-17T10:59:33.975 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: index_shortening: 1 2024-09-17T10:59:33.975 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: data_block_hash_table_util_ratio: 0.750000 2024-09-17T10:59:33.975 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: checksum: 4 2024-09-17T10:59:33.975 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: no_block_cache: 0 2024-09-17T10:59:33.975 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: block_cache: 0x557b59cd9610 2024-09-17T10:59:33.975 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: block_cache_name: BinnedLRUCache 2024-09-17T10:59:33.975 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: block_cache_options: 2024-09-17T10:59:33.976 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: capacity : 536870912 2024-09-17T10:59:33.976 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: num_shard_bits : 4 2024-09-17T10:59:33.976 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: strict_capacity_limit : 0 2024-09-17T10:59:33.976 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: high_pri_pool_ratio: 0.000 2024-09-17T10:59:33.976 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: block_cache_compressed: (nil) 2024-09-17T10:59:33.976 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: persistent_cache: (nil) 2024-09-17T10:59:33.976 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: block_size: 4096 2024-09-17T10:59:33.977 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: block_size_deviation: 10 2024-09-17T10:59:33.977 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: block_restart_interval: 16 2024-09-17T10:59:33.977 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: index_block_restart_interval: 1 2024-09-17T10:59:33.977 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: metadata_block_size: 4096 2024-09-17T10:59:33.977 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: partition_filters: 0 2024-09-17T10:59:33.977 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: use_delta_encoding: 1 2024-09-17T10:59:33.977 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: filter_policy: bloomfilter 2024-09-17T10:59:33.978 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: whole_key_filtering: 1 2024-09-17T10:59:33.978 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: verify_compression: 0 2024-09-17T10:59:33.978 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: read_amp_bytes_per_bit: 0 2024-09-17T10:59:33.978 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: format_version: 5 2024-09-17T10:59:33.978 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: enable_index_compression: 1 2024-09-17T10:59:33.978 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: block_align: 0 2024-09-17T10:59:33.979 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: max_auto_readahead_size: 262144 2024-09-17T10:59:33.979 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: prepopulate_block_cache: 0 2024-09-17T10:59:33.979 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: initial_auto_readahead_size: 8192 2024-09-17T10:59:33.980 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: num_file_reads_for_auto_readahead: 2 2024-09-17T10:59:33.980 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-17T10:59:33.980 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-17T10:59:33.982 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compression: NoCompression 2024-09-17T10:59:33.982 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-17T10:59:33.982 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-17T10:59:33.982 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T10:59:33.982 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.num_levels: 7 2024-09-17T10:59:33.982 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T10:59:33.983 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T10:59:33.983 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T10:59:33.983 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T10:59:33.983 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T10:59:33.983 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T10:59:33.983 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T10:59:33.983 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T10:59:33.983 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T10:59:33.983 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T10:59:33.984 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T10:59:33.984 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T10:59:33.984 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T10:59:33.984 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-17T10:59:33.984 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-17T10:59:33.984 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T10:59:33.984 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T10:59:33.985 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T10:59:33.985 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T10:59:33.985 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-17T10:59:33.985 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T10:59:33.985 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T10:59:33.985 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T10:59:33.986 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T10:59:33.986 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-17T10:59:33.986 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T10:59:33.986 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T10:59:33.986 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T10:59:33.986 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T10:59:33.986 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T10:59:33.986 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T10:59:33.986 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T10:59:33.986 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T10:59:33.987 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T10:59:33.987 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T10:59:33.987 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T10:59:33.987 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T10:59:33.987 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T10:59:33.987 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T10:59:33.987 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-17T10:59:33.987 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T10:59:33.987 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T10:59:33.987 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-17T10:59:33.987 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T10:59:33.987 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T10:59:33.988 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T10:59:33.988 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T10:59:33.988 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T10:59:33.988 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T10:59:33.988 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T10:59:33.988 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T10:59:33.989 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T10:59:33.989 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T10:59:33.989 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T10:59:33.989 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-17T10:59:33.989 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T10:59:33.989 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T10:59:33.989 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T10:59:33.989 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T10:59:33.989 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.bloom_locality: 0 2024-09-17T10:59:33.990 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-17T10:59:33.990 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T10:59:33.990 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-17T10:59:33.990 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-17T10:59:33.990 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-17T10:59:33.990 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.ttl: 2592000 2024-09-17T10:59:33.990 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T10:59:33.991 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T10:59:33.991 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T10:59:33.991 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.enable_blob_files: false 2024-09-17T10:59:33.991 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.min_blob_size: 0 2024-09-17T10:59:33.991 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-17T10:59:33.991 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T10:59:33.991 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T10:59:33.991 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T10:59:33.991 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T10:59:33.992 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T10:59:33.992 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-17T10:59:33.992 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T10:59:33.992 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-17T10:59:33.992 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-17T10:59:33.992 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e8182dd8-598b-44bc-8516-659013fa7908 2024-09-17T10:59:33.992 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726570773754765, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-17T10:59:33.992 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-17T10:59:33.993 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.749+0000 7ff0c3a62c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726570773755774, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 85855, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 261, "table_properties": {"data_size": 84002, "index_size": 237, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10246, "raw_average_key_size": 46, "raw_value_size": 78153, "raw_average_value_size": 355, "num_data_blocks": 11, "num_entries": 220, "num_filter_entries": 220, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726570773, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e8182dd8-598b-44bc-8516-659013fa7908", "db_session_id": "TF3MQIZDSXD7G5OLEMU8", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-17T10:59:33.993 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0c3a62c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726570773755918, "job": 1, "event": "recovery_finished"} 2024-09-17T10:59:33.993 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0c3a62c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-17T10:59:33.993 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0c3a62c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T10:59:33.993 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0c3a62c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557b59d06e00 2024-09-17T10:59:33.993 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0c3a62c80 4 rocksdb: DB pointer 0x557b59e0a000 2024-09-17T10:59:33.993 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0b982a640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T10:59:33.994 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0b982a640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T10:59:33.994 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: ** DB Stats ** 2024-09-17T10:59:33.994 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T10:59:33.994 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T10:59:33.994 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T10:59:33.994 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T10:59:33.994 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T10:59:33.994 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T10:59:33.994 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T10:59:33.995 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: ** Compaction Stats [default] ** 2024-09-17T10:59:33.995 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T10:59:33.995 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T10:59:33.995 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: L0 2/0 85.70 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T10:59:33.995 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Sum 2/0 85.70 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T10:59:33.995 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T10:59:33.995 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: ** Compaction Stats [default] ** 2024-09-17T10:59:33.996 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T10:59:33.996 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T10:59:33.996 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 132.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T10:59:33.996 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T10:59:33.996 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T10:59:33.996 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T10:59:33.996 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T10:59:33.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T10:59:33.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T10:59:33.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: AddFile(Keys): cumulative 0, interval 0 2024-09-17T10:59:33.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Cumulative compaction: 0.00 GB write, 21.72 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T10:59:33.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Interval compaction: 0.00 GB write, 21.72 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T10:59:33.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T10:59:33.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Block cache BinnedLRUCache@0x557b59cd9610#7 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2024-09-17T10:59:33.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2024-09-17T10:59:33.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: ** File Read Latency Histogram By Level [default] ** 2024-09-17T10:59:33.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0c3a62c80 0 starting mon.a rank 0 at public addrs [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] at bind addrs [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:59:33.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0c3a62c80 1 mon.a@-1(???) e1 preinit fsid b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:59:33.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0c3a62c80 0 mon.a@-1(???).mds e1 new map 2024-09-17T10:59:33.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0c3a62c80 0 mon.a@-1(???).mds e1 print_map 2024-09-17T10:59:33.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: e1 2024-09-17T10:59:33.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: btime 2024-09-17T10:59:27:449088+0000 2024-09-17T10:59:33.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T10:59:33.999 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T10:59:33.999 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: legacy client fscid: -1 2024-09-17T10:59:33.999 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: 2024-09-17T10:59:33.999 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: No filesystems configured 2024-09-17T10:59:33.999 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0c3a62c80 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T10:59:33.999 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0c3a62c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T10:59:33.999 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0c3a62c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T10:59:34.000 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0c3a62c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T10:59:34.000 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: debug 2024-09-17T10:59:33.753+0000 7ff0c3a62c80 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-17T10:59:34.000 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784289+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-17T10:59:34.000 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784289+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-17T10:59:34.000 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784352+0000 mon.a (mon.0) 2 : cluster [DBG] monmap epoch 1 2024-09-17T10:59:34.000 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784352+0000 mon.a (mon.0) 2 : cluster [DBG] monmap epoch 1 2024-09-17T10:59:34.000 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784360+0000 mon.a (mon.0) 3 : cluster [DBG] fsid b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:59:34.000 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784360+0000 mon.a (mon.0) 3 : cluster [DBG] fsid b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:59:34.001 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784366+0000 mon.a (mon.0) 4 : cluster [DBG] last_changed 2024-09-17T10:59:22.724865+0000 2024-09-17T10:59:34.001 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784366+0000 mon.a (mon.0) 4 : cluster [DBG] last_changed 2024-09-17T10:59:22.724865+0000 2024-09-17T10:59:34.001 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784372+0000 mon.a (mon.0) 5 : cluster [DBG] created 2024-09-17T10:59:22.724865+0000 2024-09-17T10:59:34.001 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784372+0000 mon.a (mon.0) 5 : cluster [DBG] created 2024-09-17T10:59:22.724865+0000 2024-09-17T10:59:34.001 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784379+0000 mon.a (mon.0) 6 : cluster [DBG] min_mon_release 19 (squid) 2024-09-17T10:59:34.001 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784379+0000 mon.a (mon.0) 6 : cluster [DBG] min_mon_release 19 (squid) 2024-09-17T10:59:34.001 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784386+0000 mon.a (mon.0) 7 : cluster [DBG] election_strategy: 1 2024-09-17T10:59:34.002 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784386+0000 mon.a (mon.0) 7 : cluster [DBG] election_strategy: 1 2024-09-17T10:59:34.002 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784393+0000 mon.a (mon.0) 8 : cluster [DBG] 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-17T10:59:34.002 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784393+0000 mon.a (mon.0) 8 : cluster [DBG] 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-17T10:59:34.002 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784808+0000 mon.a (mon.0) 9 : cluster [DBG] fsmap 2024-09-17T10:59:34.002 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784808+0000 mon.a (mon.0) 9 : cluster [DBG] fsmap 2024-09-17T10:59:34.002 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784833+0000 mon.a (mon.0) 10 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-17T10:59:34.002 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.784833+0000 mon.a (mon.0) 10 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-17T10:59:34.002 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.785225+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e1: no daemons active 2024-09-17T10:59:34.003 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:33 smithi066 bash[19869]: cluster 2024-09-17T10:59:33.785225+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e1: no daemons active 2024-09-17T10:59:34.578 INFO:teuthology.orchestra.run.smithi066.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-17T10:59:34.604 INFO:teuthology.orchestra.run.smithi066.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-17T10:59:34.605 INFO:teuthology.orchestra.run.smithi066.stdout:Creating mgr... 2024-09-17T10:59:34.605 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-17T10:59:34.605 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-17T10:59:34.929 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:34 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T10:59:34.929 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:34 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T10:59:34.929 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:34 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T10:59:34.935 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mgr.x 2024-09-17T10:59:34.936 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to reset failed state of unit ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-17T10:59:35.144 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968.target.wants/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mgr.x.service -> /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service. 2024-09-17T10:59:35.153 INFO:teuthology.orchestra.run.smithi066.stdout:firewalld does not appear to be present 2024-09-17T10:59:35.154 INFO:teuthology.orchestra.run.smithi066.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T10:59:35.154 INFO:teuthology.orchestra.run.smithi066.stdout:firewalld does not appear to be present 2024-09-17T10:59:35.154 INFO:teuthology.orchestra.run.smithi066.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-17T10:59:35.154 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mgr to start... 2024-09-17T10:59:35.154 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mgr... 2024-09-17T10:59:35.206 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:35 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T10:59:35.206 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:35 smithi066 systemd[1]: Started Ceph mgr.x for b966aac8-74e3-11ef-bceb-c7b262605968. 2024-09-17T10:59:35.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:34 smithi066 bash[19869]: audit 2024-09-17T10:59:33.996323+0000 mon.a (mon.0) 12 : audit [INF] from='client.? 172.21.15.66:0/4145279669' entity='client.admin' 2024-09-17T10:59:35.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:34 smithi066 bash[19869]: audit 2024-09-17T10:59:33.996323+0000 mon.a (mon.0) 12 : audit [INF] from='client.? 172.21.15.66:0/4145279669' entity='client.admin' 2024-09-17T10:59:35.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:35 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T10:59:37.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:36 smithi066 bash[19869]: audit 2024-09-17T10:59:36.909757+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.66:0/3366731302' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-17T10:59:37.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:36 smithi066 bash[19869]: audit 2024-09-17T10:59:36.909757+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.66:0/3366731302' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-17T10:59:37.469 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-17T10:59:37.469 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-17T10:59:37.470 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsid": "b966aac8-74e3-11ef-bceb-c7b262605968", 2024-09-17T10:59:37.470 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T10:59:37.470 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T10:59:37.470 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T10:59:37.470 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T10:59:37.470 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:37.470 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T10:59:37.470 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T10:59:37.470 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 0 2024-09-17T10:59:37.470 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-17T10:59:37.470 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T10:59:37.470 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "a" 2024-09-17T10:59:37.470 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-17T10:59:37.471 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-17T10:59:37.471 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T10:59:37.471 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T10:59:37.471 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-17T10:59:37.471 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T10:59:37.471 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:37.471 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T10:59:37.471 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T10:59:37.471 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T10:59:37.471 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T10:59:37.471 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T10:59:37.471 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T10:59:37.472 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T10:59:37.472 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T10:59:37.472 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:37.472 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T10:59:37.472 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T10:59:37.472 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T10:59:37.472 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T10:59:37.472 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T10:59:37.472 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T10:59:37.472 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T10:59:37.472 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T10:59:37.472 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T10:59:37.472 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:37.473 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T10:59:37.473 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T10:59:37.473 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "btime": "2024-09-17T10:59:27:449088+0000", 2024-09-17T10:59:37.473 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T10:59:37.473 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T10:59:37.473 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:37.473 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T10:59:37.473 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T10:59:37.473 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T10:59:37.473 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T10:59:37.473 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T10:59:37.473 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T10:59:37.473 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T10:59:37.473 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-17T10:59:37.474 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T10:59:37.474 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:37.474 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T10:59:37.474 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T10:59:37.474 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T10:59:27.449847+0000", 2024-09-17T10:59:37.474 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T10:59:37.474 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:37.474 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T10:59:37.474 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-17T10:59:37.474 INFO:teuthology.orchestra.run.smithi066.stdout:mgr not available, waiting (1/15)... 2024-09-17T10:59:41.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:40 smithi066 bash[19869]: audit 2024-09-17T10:59:40.701238+0000 mon.a (mon.0) 14 : audit [DBG] from='client.? 172.21.15.66:0/1926602007' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-17T10:59:41.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:40 smithi066 bash[19869]: audit 2024-09-17T10:59:40.701238+0000 mon.a (mon.0) 14 : audit [DBG] from='client.? 172.21.15.66:0/1926602007' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-17T10:59:41.262 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-17T10:59:41.263 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-17T10:59:41.263 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsid": "b966aac8-74e3-11ef-bceb-c7b262605968", 2024-09-17T10:59:41.263 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T10:59:41.263 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T10:59:41.265 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T10:59:41.265 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T10:59:41.265 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:41.265 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T10:59:41.265 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T10:59:41.265 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 0 2024-09-17T10:59:41.265 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-17T10:59:41.266 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T10:59:41.266 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "a" 2024-09-17T10:59:41.266 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-17T10:59:41.266 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-17T10:59:41.266 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T10:59:41.266 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T10:59:41.266 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-17T10:59:41.266 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T10:59:41.267 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:41.267 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T10:59:41.267 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T10:59:41.267 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T10:59:41.267 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T10:59:41.267 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T10:59:41.268 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T10:59:41.268 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T10:59:41.268 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T10:59:41.268 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:41.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T10:59:41.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T10:59:41.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T10:59:41.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T10:59:41.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T10:59:41.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T10:59:41.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T10:59:41.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T10:59:41.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T10:59:41.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:41.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T10:59:41.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T10:59:41.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "btime": "2024-09-17T10:59:27:449088+0000", 2024-09-17T10:59:41.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T10:59:41.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T10:59:41.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:41.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T10:59:41.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T10:59:41.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T10:59:41.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T10:59:41.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T10:59:41.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T10:59:41.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T10:59:41.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-17T10:59:41.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T10:59:41.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:41.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T10:59:41.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T10:59:41.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T10:59:27.449847+0000", 2024-09-17T10:59:41.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T10:59:41.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:41.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T10:59:41.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-17T10:59:41.274 INFO:teuthology.orchestra.run.smithi066.stdout:mgr not available, waiting (2/15)... 2024-09-17T10:59:42.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: cluster 2024-09-17T10:59:42.938746+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon x 2024-09-17T10:59:42.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: cluster 2024-09-17T10:59:42.938746+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon x 2024-09-17T10:59:42.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: cluster 2024-09-17T10:59:42.945803+0000 mon.a (mon.0) 16 : cluster [DBG] mgrmap e2: x(active, starting, since 0.00760276s) 2024-09-17T10:59:42.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: cluster 2024-09-17T10:59:42.945803+0000 mon.a (mon.0) 16 : cluster [DBG] mgrmap e2: x(active, starting, since 0.00760276s) 2024-09-17T10:59:42.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: audit 2024-09-17T10:59:42.947399+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-17T10:59:42.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: audit 2024-09-17T10:59:42.947399+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-17T10:59:42.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: audit 2024-09-17T10:59:42.947593+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-17T10:59:42.997 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: audit 2024-09-17T10:59:42.947593+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-17T10:59:42.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: audit 2024-09-17T10:59:42.947759+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-17T10:59:42.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: audit 2024-09-17T10:59:42.947759+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-17T10:59:42.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: audit 2024-09-17T10:59:42.948013+0000 mon.a (mon.0) 20 : audit [DBG] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-17T10:59:42.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: audit 2024-09-17T10:59:42.948013+0000 mon.a (mon.0) 20 : audit [DBG] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-17T10:59:42.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: audit 2024-09-17T10:59:42.948753+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-17T10:59:42.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: audit 2024-09-17T10:59:42.948753+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-17T10:59:42.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: cluster 2024-09-17T10:59:42.973966+0000 mon.a (mon.0) 22 : cluster [INF] Manager daemon x is now available 2024-09-17T10:59:42.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: cluster 2024-09-17T10:59:42.973966+0000 mon.a (mon.0) 22 : cluster [INF] Manager daemon x is now available 2024-09-17T10:59:42.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: audit 2024-09-17T10:59:42.986243+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-17T10:59:42.998 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: audit 2024-09-17T10:59:42.986243+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-17T10:59:43.370 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: audit 2024-09-17T10:59:42.988990+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-17T10:59:43.370 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:42 smithi066 bash[19869]: audit 2024-09-17T10:59:42.988990+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-17T10:59:44.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:43 smithi066 bash[19869]: audit 2024-09-17T10:59:42.991219+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' 2024-09-17T10:59:44.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:43 smithi066 bash[19869]: audit 2024-09-17T10:59:42.991219+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' 2024-09-17T10:59:44.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:44 smithi066 bash[19869]: audit 2024-09-17T10:59:43.004028+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' 2024-09-17T10:59:44.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:44 smithi066 bash[19869]: audit 2024-09-17T10:59:43.004028+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' 2024-09-17T10:59:44.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:44 smithi066 bash[19869]: audit 2024-09-17T10:59:43.006796+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' 2024-09-17T10:59:44.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:44 smithi066 bash[19869]: audit 2024-09-17T10:59:43.006796+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.15.66:0/207371389' entity='mgr.x' 2024-09-17T10:59:44.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:44 smithi066 bash[19869]: cluster 2024-09-17T10:59:43.952331+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e3: x(active, since 1.01413s) 2024-09-17T10:59:44.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:44 smithi066 bash[19869]: cluster 2024-09-17T10:59:43.952331+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e3: x(active, since 1.01413s) 2024-09-17T10:59:45.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:45 smithi066 bash[19869]: audit 2024-09-17T10:59:44.807337+0000 mon.a (mon.0) 29 : audit [DBG] from='client.? 172.21.15.66:0/1474666744' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-17T10:59:45.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:45 smithi066 bash[19869]: audit 2024-09-17T10:59:44.807337+0000 mon.a (mon.0) 29 : audit [DBG] from='client.? 172.21.15.66:0/1474666744' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-17T10:59:45.375 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-17T10:59:45.375 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-17T10:59:45.375 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsid": "b966aac8-74e3-11ef-bceb-c7b262605968", 2024-09-17T10:59:45.375 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T10:59:45.375 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T10:59:45.376 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T10:59:45.376 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T10:59:45.376 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:45.376 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T10:59:45.376 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T10:59:45.376 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 0 2024-09-17T10:59:45.376 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-17T10:59:45.376 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T10:59:45.376 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "a" 2024-09-17T10:59:45.376 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-17T10:59:45.376 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-17T10:59:45.376 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T10:59:45.376 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T10:59:45.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-17T10:59:45.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T10:59:45.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:45.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T10:59:45.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T10:59:45.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T10:59:45.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T10:59:45.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T10:59:45.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T10:59:45.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T10:59:45.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T10:59:45.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:45.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T10:59:45.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T10:59:45.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T10:59:45.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T10:59:45.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T10:59:45.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T10:59:45.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T10:59:45.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T10:59:45.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T10:59:45.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:45.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T10:59:45.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T10:59:45.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "btime": "2024-09-17T10:59:27:449088+0000", 2024-09-17T10:59:45.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T10:59:45.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T10:59:45.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:45.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T10:59:45.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T10:59:45.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T10:59:45.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T10:59:45.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T10:59:45.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T10:59:45.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T10:59:45.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-17T10:59:45.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T10:59:45.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:45.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T10:59:45.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T10:59:45.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T10:59:27.449847+0000", 2024-09-17T10:59:45.380 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T10:59:45.380 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-17T10:59:45.380 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T10:59:45.380 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-17T10:59:45.380 INFO:teuthology.orchestra.run.smithi066.stdout:mgr is available 2024-09-17T10:59:46.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:46 smithi066 bash[19869]: cluster 2024-09-17T10:59:45.009414+0000 mon.a (mon.0) 30 : cluster [DBG] mgrmap e4: x(active, since 2s) 2024-09-17T10:59:46.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:46 smithi066 bash[19869]: cluster 2024-09-17T10:59:45.009414+0000 mon.a (mon.0) 30 : cluster [DBG] mgrmap e4: x(active, since 2s) 2024-09-17T10:59:47.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:47 smithi066 bash[19869]: audit 2024-09-17T10:59:46.764325+0000 mon.a (mon.0) 31 : audit [INF] from='client.? 172.21.15.66:0/1596892332' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-17T10:59:47.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:47 smithi066 bash[19869]: audit 2024-09-17T10:59:46.764325+0000 mon.a (mon.0) 31 : audit [INF] from='client.? 172.21.15.66:0/1596892332' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-17T10:59:47.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-17T10:59:47.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T10:59:47.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout fsid = b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T10:59:47.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-17T10:59:47.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.66:3300,v1:172.21.15.66:6789] 2024-09-17T10:59:47.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T10:59:47.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T10:59:47.378 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T10:59:47.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T10:59:47.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-17T10:59:47.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T10:59:47.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T10:59:47.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-17T10:59:47.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T10:59:47.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T10:59:47.379 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T10:59:47.379 INFO:teuthology.orchestra.run.smithi066.stdout:Enabling cephadm module... 2024-09-17T10:59:49.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:48 smithi066 bash[19869]: audit 2024-09-17T10:59:48.902615+0000 mon.a (mon.0) 32 : audit [INF] from='client.? 172.21.15.66:0/2582504822' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-17T10:59:49.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:48 smithi066 bash[19869]: audit 2024-09-17T10:59:48.902615+0000 mon.a (mon.0) 32 : audit [INF] from='client.? 172.21.15.66:0/2582504822' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-17T10:59:49.457 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:49 smithi066 bash[20129]: ignoring --setuser ceph since I am not root 2024-09-17T10:59:49.457 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:49 smithi066 bash[20129]: ignoring --setgroup ceph since I am not root 2024-09-17T10:59:50.326 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:49 smithi066 bash[19869]: audit 2024-09-17T10:59:48.954405+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.15.66:0/2582504822' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-17T10:59:50.326 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:49 smithi066 bash[19869]: audit 2024-09-17T10:59:48.954405+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.15.66:0/2582504822' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-17T10:59:50.326 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:49 smithi066 bash[19869]: cluster 2024-09-17T10:59:48.960205+0000 mon.a (mon.0) 34 : cluster [DBG] mgrmap e5: x(active, since 6s) 2024-09-17T10:59:50.326 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:49 smithi066 bash[19869]: cluster 2024-09-17T10:59:48.960205+0000 mon.a (mon.0) 34 : cluster [DBG] mgrmap e5: x(active, since 6s) 2024-09-17T10:59:51.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:50 smithi066 bash[19869]: audit 2024-09-17T10:59:50.937656+0000 mon.a (mon.0) 35 : audit [DBG] from='client.? 172.21.15.66:0/3381632058' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-17T10:59:51.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:50 smithi066 bash[19869]: audit 2024-09-17T10:59:50.937656+0000 mon.a (mon.0) 35 : audit [DBG] from='client.? 172.21.15.66:0/3381632058' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-17T10:59:51.538 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-17T10:59:51.539 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-17T10:59:51.539 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T10:59:51.539 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-17T10:59:51.539 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T10:59:51.539 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-17T10:59:51.539 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for the mgr to restart... 2024-09-17T10:59:51.539 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mgr epoch 5... 2024-09-17T10:59:55.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: cluster 2024-09-17T10:59:55.242028+0000 mon.a (mon.0) 36 : cluster [INF] Active manager daemon x restarted 2024-09-17T10:59:55.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: cluster 2024-09-17T10:59:55.242028+0000 mon.a (mon.0) 36 : cluster [INF] Active manager daemon x restarted 2024-09-17T10:59:55.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: cluster 2024-09-17T10:59:55.242486+0000 mon.a (mon.0) 37 : cluster [INF] Activating manager daemon x 2024-09-17T10:59:55.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: cluster 2024-09-17T10:59:55.242486+0000 mon.a (mon.0) 37 : cluster [INF] Activating manager daemon x 2024-09-17T10:59:55.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: cluster 2024-09-17T10:59:55.249123+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-09-17T10:59:55.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: cluster 2024-09-17T10:59:55.249123+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-09-17T10:59:55.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: cluster 2024-09-17T10:59:55.249389+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e6: x(active, starting, since 0.00708362s) 2024-09-17T10:59:55.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: cluster 2024-09-17T10:59:55.249389+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e6: x(active, starting, since 0.00708362s) 2024-09-17T10:59:55.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: audit 2024-09-17T10:59:55.250488+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-17T10:59:55.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: audit 2024-09-17T10:59:55.250488+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-17T10:59:55.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: audit 2024-09-17T10:59:55.252465+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-17T10:59:55.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: audit 2024-09-17T10:59:55.252465+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-17T10:59:55.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: audit 2024-09-17T10:59:55.253474+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-17T10:59:55.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: audit 2024-09-17T10:59:55.253474+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-17T10:59:55.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: audit 2024-09-17T10:59:55.253667+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-17T10:59:55.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: audit 2024-09-17T10:59:55.253667+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-17T10:59:55.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: audit 2024-09-17T10:59:55.253845+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-17T10:59:55.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: audit 2024-09-17T10:59:55.253845+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-17T10:59:55.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: cluster 2024-09-17T10:59:55.278224+0000 mon.a (mon.0) 45 : cluster [INF] Manager daemon x is now available 2024-09-17T10:59:55.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:55 smithi066 bash[19869]: cluster 2024-09-17T10:59:55.278224+0000 mon.a (mon.0) 45 : cluster [INF] Manager daemon x is now available 2024-09-17T10:59:56.895 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-17T10:59:56.895 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-17T10:59:56.895 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T10:59:56.896 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-17T10:59:56.896 INFO:teuthology.orchestra.run.smithi066.stdout:mgr epoch 5 is available 2024-09-17T10:59:56.896 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying orchestrator module is enabled... 2024-09-17T10:59:57.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.094082+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T10:59:57.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.094082+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T10:59:57.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.099410+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T10:59:57.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.099410+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T10:59:57.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: cephadm 2024-09-17T10:59:56.100212+0000 mgr.x (mgr.14118) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-09-17T10:59:57.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: cephadm 2024-09-17T10:59:56.100212+0000 mgr.x (mgr.14118) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-09-17T10:59:57.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.103896+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T10:59:57.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.103896+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T10:59:57.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.110556+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T10:59:57.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.110556+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T10:59:57.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.114234+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T10:59:57.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.114234+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T10:59:57.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.117896+0000 mon.a (mon.0) 51 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T10:59:57.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.117896+0000 mon.a (mon.0) 51 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T10:59:57.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.131379+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-17T10:59:57.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.131379+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-17T10:59:57.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.133136+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-17T10:59:57.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.133136+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-17T10:59:57.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.252612+0000 mgr.x (mgr.14118) 2 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T10:59:57.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.252612+0000 mgr.x (mgr.14118) 2 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T10:59:57.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: cluster 2024-09-17T10:59:56.254657+0000 mon.a (mon.0) 54 : cluster [DBG] mgrmap e7: x(active, since 1.01236s) 2024-09-17T10:59:57.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: cluster 2024-09-17T10:59:56.254657+0000 mon.a (mon.0) 54 : cluster [DBG] mgrmap e7: x(active, since 1.01236s) 2024-09-17T10:59:57.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.267472+0000 mgr.x (mgr.14118) 3 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T10:59:57.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:57 smithi066 bash[19869]: audit 2024-09-17T10:59:56.267472+0000 mgr.x (mgr.14118) 3 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T10:59:59.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: debug 2024-09-17T10:59:58.760+0000 7f3987333640 -1 log_channel(cephadm) log [ERR] : [17/Sep/2024:10:59:58] ENGINE Error in HTTPServer.serve 2024-09-17T10:59:59.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: Traceback (most recent call last): 2024-09-17T10:59:59.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T10:59:59.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: self._connections.run(self.expiration_interval) 2024-09-17T10:59:59.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T10:59:59.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: self._run(expiration_interval) 2024-09-17T10:59:59.105 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T10:59:59.105 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T10:59:59.105 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T10:59:59.105 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T10:59:59.105 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T10:59:59.105 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: s = self.context.wrap_socket( 2024-09-17T10:59:59.105 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T10:59:59.105 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: return self.sslsocket_class._create( 2024-09-17T10:59:59.105 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T10:59:59.105 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: self.do_handshake() 2024-09-17T10:59:59.105 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T10:59:59.105 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: self._sslobj.do_handshake() 2024-09-17T10:59:59.106 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 10:59:58 smithi066 bash[20129]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T10:59:59.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: cluster 2024-09-17T10:59:58.098943+0000 mon.a (mon.0) 55 : cluster [DBG] mgrmap e8: x(active, since 2s) 2024-09-17T10:59:59.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: cluster 2024-09-17T10:59:58.098943+0000 mon.a (mon.0) 55 : cluster [DBG] mgrmap e8: x(active, since 2s) 2024-09-17T10:59:59.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: audit 2024-09-17T10:59:58.385679+0000 mon.a (mon.0) 56 : audit [INF] from='client.? 172.21.15.66:0/3300220402' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-17T10:59:59.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: audit 2024-09-17T10:59:58.385679+0000 mon.a (mon.0) 56 : audit [INF] from='client.? 172.21.15.66:0/3300220402' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-17T10:59:59.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: cephadm 2024-09-17T10:59:58.636189+0000 mgr.x (mgr.14118) 4 : cephadm [INF] [17/Sep/2024:10:59:58] ENGINE Bus STARTING 2024-09-17T10:59:59.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: cephadm 2024-09-17T10:59:58.636189+0000 mgr.x (mgr.14118) 4 : cephadm [INF] [17/Sep/2024:10:59:58] ENGINE Bus STARTING 2024-09-17T10:59:59.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: cephadm 2024-09-17T10:59:58.760163+0000 mgr.x (mgr.14118) 5 : cephadm [INF] [17/Sep/2024:10:59:58] ENGINE Serving on https://172.21.15.66:7150 2024-09-17T10:59:59.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: cephadm 2024-09-17T10:59:58.760163+0000 mgr.x (mgr.14118) 5 : cephadm [INF] [17/Sep/2024:10:59:58] ENGINE Serving on https://172.21.15.66:7150 2024-09-17T10:59:59.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: cephadm 2024-09-17T10:59:58.763923+0000 mgr.x (mgr.14118) 6 : cephadm [ERR] [17/Sep/2024:10:59:58] ENGINE Error in HTTPServer.serve 2024-09-17T10:59:59.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: Traceback (most recent call last): 2024-09-17T10:59:59.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T10:59:59.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: self._connections.run(self.expiration_interval) 2024-09-17T10:59:59.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T10:59:59.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: self._run(expiration_interval) 2024-09-17T10:59:59.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T10:59:59.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T10:59:59.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T10:59:59.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T10:59:59.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T10:59:59.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: s = self.context.wrap_socket( 2024-09-17T10:59:59.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T10:59:59.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: return self.sslsocket_class._create( 2024-09-17T10:59:59.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T10:59:59.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: self.do_handshake() 2024-09-17T10:59:59.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T10:59:59.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: self._sslobj.do_handshake() 2024-09-17T10:59:59.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T10:59:59.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: cephadm 2024-09-17T10:59:58.763923+0000 mgr.x (mgr.14118) 6 : cephadm [ERR] [17/Sep/2024:10:59:58] ENGINE Error in HTTPServer.serve 2024-09-17T10:59:59.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: Traceback (most recent call last): 2024-09-17T10:59:59.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T10:59:59.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: self._connections.run(self.expiration_interval) 2024-09-17T10:59:59.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T10:59:59.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: self._run(expiration_interval) 2024-09-17T10:59:59.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T10:59:59.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T10:59:59.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T10:59:59.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T10:59:59.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T10:59:59.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: s = self.context.wrap_socket( 2024-09-17T10:59:59.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T10:59:59.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: return self.sslsocket_class._create( 2024-09-17T10:59:59.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T10:59:59.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: self.do_handshake() 2024-09-17T10:59:59.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T10:59:59.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: self._sslobj.do_handshake() 2024-09-17T10:59:59.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T10:59:59.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: cephadm 2024-09-17T10:59:58.861119+0000 mgr.x (mgr.14118) 7 : cephadm [INF] [17/Sep/2024:10:59:58] ENGINE Serving on http://172.21.15.66:8765 2024-09-17T10:59:59.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: cephadm 2024-09-17T10:59:58.861119+0000 mgr.x (mgr.14118) 7 : cephadm [INF] [17/Sep/2024:10:59:58] ENGINE Serving on http://172.21.15.66:8765 2024-09-17T10:59:59.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: cephadm 2024-09-17T10:59:58.861234+0000 mgr.x (mgr.14118) 8 : cephadm [INF] [17/Sep/2024:10:59:58] ENGINE Bus STARTED 2024-09-17T10:59:59.462 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: cephadm 2024-09-17T10:59:58.861234+0000 mgr.x (mgr.14118) 8 : cephadm [INF] [17/Sep/2024:10:59:58] ENGINE Bus STARTED 2024-09-17T10:59:59.462 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: audit 2024-09-17T10:59:58.862186+0000 mon.a (mon.0) 57 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T10:59:59.462 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 10:59:59 smithi066 bash[19869]: audit 2024-09-17T10:59:58.862186+0000 mon.a (mon.0) 57 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T10:59:59.752 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-17T10:59:59.752 INFO:teuthology.orchestra.run.smithi066.stdout:Setting orchestrator backend to cephadm... 2024-09-17T11:00:00.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:00 smithi066 bash[19869]: audit 2024-09-17T10:59:59.094756+0000 mon.a (mon.0) 58 : audit [INF] from='client.? 172.21.15.66:0/3300220402' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-17T11:00:00.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:00 smithi066 bash[19869]: audit 2024-09-17T10:59:59.094756+0000 mon.a (mon.0) 58 : audit [INF] from='client.? 172.21.15.66:0/3300220402' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-17T11:00:00.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:00 smithi066 bash[19869]: cluster 2024-09-17T10:59:59.101213+0000 mon.a (mon.0) 59 : cluster [DBG] mgrmap e9: x(active, since 3s) 2024-09-17T11:00:00.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:00 smithi066 bash[19869]: cluster 2024-09-17T10:59:59.101213+0000 mon.a (mon.0) 59 : cluster [DBG] mgrmap e9: x(active, since 3s) 2024-09-17T11:00:02.443 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:02 smithi066 bash[19869]: audit 2024-09-17T11:00:01.065450+0000 mgr.x (mgr.14118) 9 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:02.443 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:02 smithi066 bash[19869]: audit 2024-09-17T11:00:01.065450+0000 mgr.x (mgr.14118) 9 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:02.443 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:02 smithi066 bash[19869]: audit 2024-09-17T11:00:01.073740+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:02.443 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:02 smithi066 bash[19869]: audit 2024-09-17T11:00:01.073740+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:02.443 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:02 smithi066 bash[19869]: audit 2024-09-17T11:00:01.089845+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:00:02.444 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:02 smithi066 bash[19869]: audit 2024-09-17T11:00:01.089845+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:00:03.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:03 smithi066 bash[19869]: audit 2024-09-17T11:00:02.997362+0000 mgr.x (mgr.14118) 10 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:03.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:03 smithi066 bash[19869]: audit 2024-09-17T11:00:02.997362+0000 mgr.x (mgr.14118) 10 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:03.556 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-17T11:00:03.556 INFO:teuthology.orchestra.run.smithi066.stdout:Generating ssh key... 2024-09-17T11:00:05.425 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[19869]: audit 2024-09-17T11:00:04.898052+0000 mgr.x (mgr.14118) 11 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:05.425 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[19869]: audit 2024-09-17T11:00:04.898052+0000 mgr.x (mgr.14118) 11 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:05.425 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[19869]: cephadm 2024-09-17T11:00:04.898447+0000 mgr.x (mgr.14118) 12 : cephadm [INF] Generating ssh key... 2024-09-17T11:00:05.425 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[19869]: cephadm 2024-09-17T11:00:04.898447+0000 mgr.x (mgr.14118) 12 : cephadm [INF] Generating ssh key... 2024-09-17T11:00:05.706 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: Generating public/private rsa key pair. 2024-09-17T11:00:05.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: Your identification has been saved in /tmp/tmpvy4q9l1k/key 2024-09-17T11:00:05.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: Your public key has been saved in /tmp/tmpvy4q9l1k/key.pub 2024-09-17T11:00:05.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: The key fingerprint is: 2024-09-17T11:00:05.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: SHA256:l2rvaRhDMaSg0zgaOKxlrZvZm2EpnpsWaDovVUvAoyk ceph-b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T11:00:05.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: The key's randomart image is: 2024-09-17T11:00:05.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: +---[RSA 3072]----+ 2024-09-17T11:00:05.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: | . . .. | 2024-09-17T11:00:05.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: |o += . .o | 2024-09-17T11:00:05.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: |++Boo . o | 2024-09-17T11:00:05.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: |E* +o . . | 2024-09-17T11:00:05.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: |+..o . .S o | 2024-09-17T11:00:05.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: |..o=.. oo | 2024-09-17T11:00:05.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: |o.=.= o+ | 2024-09-17T11:00:05.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: |+..= + ..... | 2024-09-17T11:00:05.708 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: | =*.o o+ | 2024-09-17T11:00:05.708 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:05 smithi066 bash[20129]: +----[SHA256]-----+ 2024-09-17T11:00:06.706 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:06 smithi066 bash[19869]: audit 2024-09-17T11:00:05.431086+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:06.706 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:06 smithi066 bash[19869]: audit 2024-09-17T11:00:05.431086+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:06.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:06 smithi066 bash[19869]: audit 2024-09-17T11:00:05.436287+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:06.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:06 smithi066 bash[19869]: audit 2024-09-17T11:00:05.436287+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:07.944 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCKcAqQlW4JvocSXcGT9vLE8ueoZ5/QArE74KT9HNZREpnRCPI8DYKW5/pXVE9/Epi9Aoh/cENOgbDxs9TkJcrkG/1ZIB4JjcyFvcRXDL6LUcwWsg1DPCcn0DyxODgyCK2w6lzegmcogJ6rthEkaCbwYhYSonYYLf1mU2uHkI8JXhZqaSFa0tSzIDdVVXgix7EqqH+eCGxXX8FfO6w3Mq4XOlVhmszLMbgjh1sSUAr04MV0JtvKZb1Zsw/9rrEXd+bCe+as0VYucJNliMPJKQSC+ub6IkvaqSHErvJImU6KM2rUeE+mRCoFF/W7TPGfU7KgnvF2deBSawvMrBjOQzfu8p94YAW5ip2SOb31diyZeA7RYYXrKRiPPnZWeqNMRiwIDL5E7a/1rDRQ1zO4smunLCaPmtyTAJ5UtnrFLmmxbQ10y49kFBpL5STdXm75unidBEx8BEuQZJ4lyYKareitb/UsARC1hbmMPdP9AgmDpVrfKjwiOiuD3S9B4FO/x7M= ceph-b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T11:00:07.944 INFO:teuthology.orchestra.run.smithi066.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-17T11:00:07.945 INFO:teuthology.orchestra.run.smithi066.stdout:Adding key to root@localhost authorized_keys... 2024-09-17T11:00:07.945 INFO:teuthology.orchestra.run.smithi066.stdout:Adding host smithi066... 2024-09-17T11:00:08.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:08 smithi066 bash[19869]: audit 2024-09-17T11:00:07.354360+0000 mgr.x (mgr.14118) 13 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:08.456 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:08 smithi066 bash[19869]: audit 2024-09-17T11:00:07.354360+0000 mgr.x (mgr.14118) 13 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:10.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:10 smithi066 bash[19869]: audit 2024-09-17T11:00:09.485074+0000 mgr.x (mgr.14118) 14 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi066", "addr": "172.21.15.66", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:10.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:10 smithi066 bash[19869]: audit 2024-09-17T11:00:09.485074+0000 mgr.x (mgr.14118) 14 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi066", "addr": "172.21.15.66", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:11.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:11 smithi066 bash[19869]: cephadm 2024-09-17T11:00:10.742040+0000 mgr.x (mgr.14118) 15 : cephadm [INF] Deploying cephadm binary to smithi066 2024-09-17T11:00:11.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:11 smithi066 bash[19869]: cephadm 2024-09-17T11:00:10.742040+0000 mgr.x (mgr.14118) 15 : cephadm [INF] Deploying cephadm binary to smithi066 2024-09-17T11:00:15.116 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Added host 'smithi066' with addr '172.21.15.66' 2024-09-17T11:00:15.117 INFO:teuthology.orchestra.run.smithi066.stdout:Deploying unmanaged mon service... 2024-09-17T11:00:15.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:15 smithi066 bash[19869]: audit 2024-09-17T11:00:14.302086+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:15.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:15 smithi066 bash[19869]: audit 2024-09-17T11:00:14.302086+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:15.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:15 smithi066 bash[19869]: cephadm 2024-09-17T11:00:14.302474+0000 mgr.x (mgr.14118) 16 : cephadm [INF] Added host smithi066 2024-09-17T11:00:15.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:15 smithi066 bash[19869]: cephadm 2024-09-17T11:00:14.302474+0000 mgr.x (mgr.14118) 16 : cephadm [INF] Added host smithi066 2024-09-17T11:00:15.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:15 smithi066 bash[19869]: audit 2024-09-17T11:00:14.302808+0000 mon.a (mon.0) 65 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:00:15.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:15 smithi066 bash[19869]: audit 2024-09-17T11:00:14.302808+0000 mon.a (mon.0) 65 : audit [DBG] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:00:16.629 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:16 smithi066 bash[19869]: cluster 2024-09-17T11:00:15.255152+0000 mgr.x (mgr.14118) 17 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:16.629 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:16 smithi066 bash[19869]: cluster 2024-09-17T11:00:15.255152+0000 mgr.x (mgr.14118) 17 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:17.999 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-17T11:00:17.999 INFO:teuthology.orchestra.run.smithi066.stdout:Deploying unmanaged mgr service... 2024-09-17T11:00:18.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:18 smithi066 bash[19869]: audit 2024-09-17T11:00:17.212417+0000 mgr.x (mgr.14118) 18 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:18.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:18 smithi066 bash[19869]: audit 2024-09-17T11:00:17.212417+0000 mgr.x (mgr.14118) 18 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:18.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:18 smithi066 bash[19869]: cephadm 2024-09-17T11:00:17.215358+0000 mgr.x (mgr.14118) 19 : cephadm [INF] Saving service mon spec with placement count:5 2024-09-17T11:00:18.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:18 smithi066 bash[19869]: cephadm 2024-09-17T11:00:17.215358+0000 mgr.x (mgr.14118) 19 : cephadm [INF] Saving service mon spec with placement count:5 2024-09-17T11:00:18.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:18 smithi066 bash[19869]: audit 2024-09-17T11:00:17.220347+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:18.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:18 smithi066 bash[19869]: audit 2024-09-17T11:00:17.220347+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:18.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:18 smithi066 bash[19869]: cluster 2024-09-17T11:00:17.255465+0000 mgr.x (mgr.14118) 20 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:18.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:18 smithi066 bash[19869]: cluster 2024-09-17T11:00:17.255465+0000 mgr.x (mgr.14118) 20 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:18.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:18 smithi066 bash[19869]: audit 2024-09-17T11:00:17.936558+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:18.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:18 smithi066 bash[19869]: audit 2024-09-17T11:00:17.936558+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:19.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:19 smithi066 bash[19869]: audit 2024-09-17T11:00:18.526166+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:19.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:19 smithi066 bash[19869]: audit 2024-09-17T11:00:18.526166+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:20.106 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-17T11:00:20.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:20 smithi066 bash[19869]: cluster 2024-09-17T11:00:19.255854+0000 mgr.x (mgr.14118) 21 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:20.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:20 smithi066 bash[19869]: cluster 2024-09-17T11:00:19.255854+0000 mgr.x (mgr.14118) 21 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:20.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:20 smithi066 bash[19869]: audit 2024-09-17T11:00:19.525241+0000 mgr.x (mgr.14118) 22 : audit [DBG] from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:20.942 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:20 smithi066 bash[19869]: audit 2024-09-17T11:00:19.525241+0000 mgr.x (mgr.14118) 22 : audit [DBG] from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:20.942 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:20 smithi066 bash[19869]: cephadm 2024-09-17T11:00:19.527452+0000 mgr.x (mgr.14118) 23 : cephadm [INF] Saving service mgr spec with placement count:2 2024-09-17T11:00:20.942 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:20 smithi066 bash[19869]: cephadm 2024-09-17T11:00:19.527452+0000 mgr.x (mgr.14118) 23 : cephadm [INF] Saving service mgr spec with placement count:2 2024-09-17T11:00:20.942 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:20 smithi066 bash[19869]: audit 2024-09-17T11:00:19.531856+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:20.942 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:20 smithi066 bash[19869]: audit 2024-09-17T11:00:19.531856+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.14118 172.21.15.66:0/1467840167' entity='mgr.x' 2024-09-17T11:00:22.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:22 smithi066 bash[19869]: cluster 2024-09-17T11:00:21.256196+0000 mgr.x (mgr.14118) 24 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:22.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:22 smithi066 bash[19869]: cluster 2024-09-17T11:00:21.256196+0000 mgr.x (mgr.14118) 24 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:22.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:22 smithi066 bash[19869]: audit 2024-09-17T11:00:21.497377+0000 mon.a (mon.0) 70 : audit [INF] from='client.? 172.21.15.66:0/3652557358' entity='client.admin' 2024-09-17T11:00:22.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:22 smithi066 bash[19869]: audit 2024-09-17T11:00:21.497377+0000 mon.a (mon.0) 70 : audit [INF] from='client.? 172.21.15.66:0/3652557358' entity='client.admin' 2024-09-17T11:00:23.986 INFO:teuthology.orchestra.run.smithi066.stdout:Enabling the dashboard module... 2024-09-17T11:00:24.706 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:24 smithi066 bash[19869]: cluster 2024-09-17T11:00:23.256578+0000 mgr.x (mgr.14118) 25 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:24.706 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:24 smithi066 bash[19869]: cluster 2024-09-17T11:00:23.256578+0000 mgr.x (mgr.14118) 25 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:24.706 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:24 smithi066 bash[19869]: audit 2024-09-17T11:00:23.433832+0000 mon.a (mon.0) 71 : audit [INF] from='client.? 172.21.15.66:0/515019557' entity='client.admin' 2024-09-17T11:00:24.706 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:24 smithi066 bash[19869]: audit 2024-09-17T11:00:23.433832+0000 mon.a (mon.0) 71 : audit [INF] from='client.? 172.21.15.66:0/515019557' entity='client.admin' 2024-09-17T11:00:26.684 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:26 smithi066 bash[19869]: cluster 2024-09-17T11:00:25.256906+0000 mgr.x (mgr.14118) 26 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:26.685 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:26 smithi066 bash[19869]: cluster 2024-09-17T11:00:25.256906+0000 mgr.x (mgr.14118) 26 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:26.685 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:26 smithi066 bash[19869]: audit 2024-09-17T11:00:25.484815+0000 mon.a (mon.0) 72 : audit [INF] from='client.? 172.21.15.66:0/2148296073' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-17T11:00:26.685 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:26 smithi066 bash[19869]: audit 2024-09-17T11:00:25.484815+0000 mon.a (mon.0) 72 : audit [INF] from='client.? 172.21.15.66:0/2148296073' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-17T11:00:26.685 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:26 smithi066 bash[20129]: ignoring --setuser ceph since I am not root 2024-09-17T11:00:26.685 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:26 smithi066 bash[20129]: ignoring --setgroup ceph since I am not root 2024-09-17T11:00:27.706 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:27 smithi066 bash[19869]: audit 2024-09-17T11:00:26.443146+0000 mon.a (mon.0) 73 : audit [INF] from='client.? 172.21.15.66:0/2148296073' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-17T11:00:27.706 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:27 smithi066 bash[19869]: audit 2024-09-17T11:00:26.443146+0000 mon.a (mon.0) 73 : audit [INF] from='client.? 172.21.15.66:0/2148296073' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-17T11:00:27.706 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:27 smithi066 bash[19869]: cluster 2024-09-17T11:00:26.450492+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e10: x(active, since 31s) 2024-09-17T11:00:27.706 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:27 smithi066 bash[19869]: cluster 2024-09-17T11:00:26.450492+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e10: x(active, since 31s) 2024-09-17T11:00:28.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:28 smithi066 bash[19869]: audit 2024-09-17T11:00:28.559130+0000 mon.a (mon.0) 75 : audit [DBG] from='client.? 172.21.15.66:0/4049485999' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-17T11:00:28.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:28 smithi066 bash[19869]: audit 2024-09-17T11:00:28.559130+0000 mon.a (mon.0) 75 : audit [DBG] from='client.? 172.21.15.66:0/4049485999' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-17T11:00:29.124 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-17T11:00:29.125 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 10, 2024-09-17T11:00:29.125 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T11:00:29.125 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-17T11:00:29.125 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T11:00:29.125 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-17T11:00:29.125 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for the mgr to restart... 2024-09-17T11:00:29.125 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mgr epoch 10... 2024-09-17T11:00:33.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: cluster 2024-09-17T11:00:32.745879+0000 mon.a (mon.0) 76 : cluster [INF] Active manager daemon x restarted 2024-09-17T11:00:33.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: cluster 2024-09-17T11:00:32.745879+0000 mon.a (mon.0) 76 : cluster [INF] Active manager daemon x restarted 2024-09-17T11:00:33.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: cluster 2024-09-17T11:00:32.746350+0000 mon.a (mon.0) 77 : cluster [INF] Activating manager daemon x 2024-09-17T11:00:33.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: cluster 2024-09-17T11:00:32.746350+0000 mon.a (mon.0) 77 : cluster [INF] Activating manager daemon x 2024-09-17T11:00:33.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: cluster 2024-09-17T11:00:32.751800+0000 mon.a (mon.0) 78 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-09-17T11:00:33.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: cluster 2024-09-17T11:00:32.751800+0000 mon.a (mon.0) 78 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-09-17T11:00:33.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: cluster 2024-09-17T11:00:32.752022+0000 mon.a (mon.0) 79 : cluster [DBG] mgrmap e11: x(active, starting, since 0.00587741s) 2024-09-17T11:00:33.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: cluster 2024-09-17T11:00:32.752022+0000 mon.a (mon.0) 79 : cluster [DBG] mgrmap e11: x(active, starting, since 0.00587741s) 2024-09-17T11:00:33.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: audit 2024-09-17T11:00:32.753364+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-17T11:00:33.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: audit 2024-09-17T11:00:32.753364+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-17T11:00:33.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: audit 2024-09-17T11:00:32.754635+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-17T11:00:33.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: audit 2024-09-17T11:00:32.754635+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-17T11:00:33.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: audit 2024-09-17T11:00:32.755741+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-17T11:00:33.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: audit 2024-09-17T11:00:32.755741+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-17T11:00:33.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: audit 2024-09-17T11:00:32.755952+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-17T11:00:33.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: audit 2024-09-17T11:00:32.755952+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-17T11:00:33.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: audit 2024-09-17T11:00:32.756135+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-17T11:00:33.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: audit 2024-09-17T11:00:32.756135+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-17T11:00:33.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: cluster 2024-09-17T11:00:32.782248+0000 mon.a (mon.0) 85 : cluster [INF] Manager daemon x is now available 2024-09-17T11:00:33.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:32 smithi066 bash[19869]: cluster 2024-09-17T11:00:32.782248+0000 mon.a (mon.0) 85 : cluster [INF] Manager daemon x is now available 2024-09-17T11:00:34.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:33 smithi066 bash[19869]: audit 2024-09-17T11:00:33.193537+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:00:34.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:33 smithi066 bash[19869]: audit 2024-09-17T11:00:33.193537+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:00:34.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:33 smithi066 bash[19869]: audit 2024-09-17T11:00:33.209647+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-17T11:00:34.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:33 smithi066 bash[19869]: audit 2024-09-17T11:00:33.209647+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-17T11:00:34.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:33 smithi066 bash[19869]: audit 2024-09-17T11:00:33.211652+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-17T11:00:34.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:33 smithi066 bash[19869]: audit 2024-09-17T11:00:33.211652+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-17T11:00:34.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:33 smithi066 bash[19869]: cluster 2024-09-17T11:00:33.758306+0000 mon.a (mon.0) 89 : cluster [DBG] mgrmap e12: x(active, since 1.01217s) 2024-09-17T11:00:34.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:33 smithi066 bash[19869]: cluster 2024-09-17T11:00:33.758306+0000 mon.a (mon.0) 89 : cluster [DBG] mgrmap e12: x(active, since 1.01217s) 2024-09-17T11:00:34.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-17T11:00:34.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 12, 2024-09-17T11:00:34.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T11:00:34.377 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-17T11:00:34.377 INFO:teuthology.orchestra.run.smithi066.stdout:mgr epoch 10 is available 2024-09-17T11:00:34.377 INFO:teuthology.orchestra.run.smithi066.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-17T11:00:34.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: debug 2024-09-17T11:00:34.464+0000 7fe45c309640 -1 log_channel(cephadm) log [ERR] : [17/Sep/2024:11:00:34] ENGINE Error in HTTPServer.serve 2024-09-17T11:00:34.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: Traceback (most recent call last): 2024-09-17T11:00:34.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T11:00:34.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: self._connections.run(self.expiration_interval) 2024-09-17T11:00:34.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T11:00:34.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: self._run(expiration_interval) 2024-09-17T11:00:34.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T11:00:34.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T11:00:34.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T11:00:34.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T11:00:34.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T11:00:34.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: s = self.context.wrap_socket( 2024-09-17T11:00:34.708 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T11:00:34.708 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: return self.sslsocket_class._create( 2024-09-17T11:00:34.708 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T11:00:34.708 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: self.do_handshake() 2024-09-17T11:00:34.708 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T11:00:34.708 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: self._sslobj.do_handshake() 2024-09-17T11:00:34.708 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[20129]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T11:00:35.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: cephadm 2024-09-17T11:00:34.339820+0000 mgr.x (mgr.14152) 3 : cephadm [INF] [17/Sep/2024:11:00:34] ENGINE Bus STARTING 2024-09-17T11:00:35.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: cephadm 2024-09-17T11:00:34.339820+0000 mgr.x (mgr.14152) 3 : cephadm [INF] [17/Sep/2024:11:00:34] ENGINE Bus STARTING 2024-09-17T11:00:35.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: cephadm 2024-09-17T11:00:34.465505+0000 mgr.x (mgr.14152) 4 : cephadm [INF] [17/Sep/2024:11:00:34] ENGINE Serving on https://172.21.15.66:7150 2024-09-17T11:00:35.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: cephadm 2024-09-17T11:00:34.465505+0000 mgr.x (mgr.14152) 4 : cephadm [INF] [17/Sep/2024:11:00:34] ENGINE Serving on https://172.21.15.66:7150 2024-09-17T11:00:35.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: cephadm 2024-09-17T11:00:34.470040+0000 mgr.x (mgr.14152) 5 : cephadm [ERR] [17/Sep/2024:11:00:34] ENGINE Error in HTTPServer.serve 2024-09-17T11:00:35.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: Traceback (most recent call last): 2024-09-17T11:00:35.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T11:00:35.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: self._connections.run(self.expiration_interval) 2024-09-17T11:00:35.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T11:00:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: self._run(expiration_interval) 2024-09-17T11:00:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T11:00:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T11:00:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T11:00:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T11:00:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T11:00:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: s = self.context.wrap_socket( 2024-09-17T11:00:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T11:00:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: return self.sslsocket_class._create( 2024-09-17T11:00:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T11:00:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: self.do_handshake() 2024-09-17T11:00:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T11:00:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: self._sslobj.do_handshake() 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: cephadm 2024-09-17T11:00:34.470040+0000 mgr.x (mgr.14152) 5 : cephadm [ERR] [17/Sep/2024:11:00:34] ENGINE Error in HTTPServer.serve 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: Traceback (most recent call last): 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: self._connections.run(self.expiration_interval) 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: self._run(expiration_interval) 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: s = self.context.wrap_socket( 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T11:00:35.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: return self.sslsocket_class._create( 2024-09-17T11:00:35.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T11:00:35.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: self.do_handshake() 2024-09-17T11:00:35.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T11:00:35.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: self._sslobj.do_handshake() 2024-09-17T11:00:35.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:34 smithi066 bash[19869]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T11:00:36.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:35 smithi066 bash[19869]: cephadm 2024-09-17T11:00:34.566662+0000 mgr.x (mgr.14152) 6 : cephadm [INF] [17/Sep/2024:11:00:34] ENGINE Serving on http://172.21.15.66:8765 2024-09-17T11:00:36.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:35 smithi066 bash[19869]: cephadm 2024-09-17T11:00:34.566662+0000 mgr.x (mgr.14152) 6 : cephadm [INF] [17/Sep/2024:11:00:34] ENGINE Serving on http://172.21.15.66:8765 2024-09-17T11:00:36.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:35 smithi066 bash[19869]: cephadm 2024-09-17T11:00:34.566799+0000 mgr.x (mgr.14152) 7 : cephadm [INF] [17/Sep/2024:11:00:34] ENGINE Bus STARTED 2024-09-17T11:00:36.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:35 smithi066 bash[19869]: cephadm 2024-09-17T11:00:34.566799+0000 mgr.x (mgr.14152) 7 : cephadm [INF] [17/Sep/2024:11:00:34] ENGINE Bus STARTED 2024-09-17T11:00:36.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:35 smithi066 bash[19869]: cluster 2024-09-17T11:00:34.817538+0000 mon.a (mon.0) 90 : cluster [DBG] mgrmap e13: x(active, since 2s) 2024-09-17T11:00:36.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:35 smithi066 bash[19869]: cluster 2024-09-17T11:00:34.817538+0000 mon.a (mon.0) 90 : cluster [DBG] mgrmap e13: x(active, since 2s) 2024-09-17T11:00:37.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:36 smithi066 bash[19869]: audit 2024-09-17T11:00:35.776943+0000 mgr.x (mgr.14152) 8 : audit [DBG] from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:37.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:36 smithi066 bash[19869]: audit 2024-09-17T11:00:35.776943+0000 mgr.x (mgr.14152) 8 : audit [DBG] from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:37.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUWoOJAuZvSFQaJ6bafV2hN9NEV8owDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxNzExMDAzN1oXDTM0\nMDkxODExMDAzN1owFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjY2MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAmyDCkLdG2ze7SXwy3jiu9L5q3nDbWgVKPy4w\nPij2kFCqSqSWPSP1kM8tOcX5xkD4UHP1SrvtSJBAVRHtJy9D130ykU8dwUGBZFxX\n24Vmgows4wTVW4mvHnpAdkbiFguPexhswWTyKsaj1iXdpCjHaU9LkmSoCqbG+33g\nCB6uHyzszljF3XNBMRDtbLUFZVgF0i+mVxJoLfAgH4klGeydTVIPFc8/2I5BF0TS\nbOVcCX8ewoVn/rWGDxjmKE+qQZ0ultUkD+cCetBUHC/dlgp/+4q+m2NGXc0BDmTN\n9B40hj7KFcGJfxIDKlZ7Le4d5LKZqphqJkLalyibQ52PRKQNo7LFqvP2EGw+G1/P\nRO/OCVqSA4vhbpwFg7UIGJwRRsiEHpK/RJhvmqIqoMVUgpYrJMmXAd37LdKzQ1Vr\nV/pklyXsXSa090MxDwSCs3VtbR2sggwKkrYQTUlL9PE7XB97k+tFjpc8UXwmjyg0\ne3bDTwOi0p9S2lmpRUJx9V2wflRwOuZ+daSKW6pJbU3AhV/huKHUZMkxiSDIoy+0\nmN5UKXN84/O7btNCbi4c+8LHloOyM2apTHHjPS9aWqiGXb9GAT8iu6KpUq3cftUn\nWHMz0oryqfN91VRotxdh+lUemXAC5pTMdhQNx6aaJlVrkI/879x2MblcoWkfJ7HA\npAsYmDcCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDY2ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPQjAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQB1\nDxPZ6f/NQasSIJGQ7NX/1PNm6IlEOR6PC0N9xFp5Nkzzyz7vVFPYUlqikB11JO6o\nK4fsmX05vJXTbBYZCqcYXs7fvpIwQXTSvEg+fjhmAHuvcu0ML+vWVscFaq1L580I\nqmUrFnw3DVXvVXRkoQMYyhYPU0cXd0cO6TVXzuGEXRYeV6zpsyy4xx44AcbSwpyG\nMDPRnav0siL8m+8Fvk+f7S2zlwxTF7lCm8ohOHcEqLBe2pT3x4e0bcplClRK6e40\nwTFFa+41PDKXCU83+1AZNQN4lqAykAXwZpD5gGWIlSPd8M7hAQFHA41yh4rmtJol\n4WUktMw2B5PSPpD8SFiDpBvh8igSGn1BQlBfcP+PRYqpT6HiKAIT2x6QZEm13h4B\nF5J++1qQ17VwQPWVVq50o67ZIlz7jEYndO6cOfDs5x5YAONNfcTgVhC3SFigTG/4\nuMHpROW4rxqHMqyLj1/ZGue0fxDWvm9UnstbR2Lq+5+uB6XlEaWJhmNSHg9o2Frl\nS0jX4jbCJxRRa1xtIt4TabZ7km0n+k4hz/BbBWLPZlmvJewrEGNiFmPlWN/5CRwQ\nvrELMb2n/DGrg3NPqjlzQ3U03ajfchoSKCZDcPv/1/OdSqP7m75/Ds18ZfHksTz2\nJoZAOfZvbBev6kKTx5O5l/wuoDiGl+bRBIduTt45Fg==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAmyDCkLdG2ze7SXwy3jiu9L5q3nDbWgVKPy4wPij2kFCqSqSW\nPSP1kM8tOcX5xkD4UHP1SrvtSJBAVRHtJy9D130ykU8dwUGBZFxX24Vmgows4wTV\nW4mvHnpAdkbiFguPexhswWTyKsaj1iXdpCjHaU9LkmSoCqbG+33gCB6uHyzszljF\n3XNBMRDtbLUFZVgF0i+mVxJoLfAgH4klGeydTVIPFc8/2I5BF0TSbOVcCX8ewoVn\n/rWGDxjmKE+qQZ0ultUkD+cCetBUHC/dlgp/+4q+m2NGXc0BDmTN9B40hj7KFcGJ\nfxIDKlZ7Le4d5LKZqphqJkLalyibQ52PRKQNo7LFqvP2EGw+G1/PRO/OCVqSA4vh\nbpwFg7UIGJwRRsiEHpK/RJhvmqIqoMVUgpYrJMmXAd37LdKzQ1VrV/pklyXsXSa0\n90MxDwSCs3VtbR2sggwKkrYQTUlL9PE7XB97k+tFjpc8UXwmjyg0e3bDTwOi0p9S\n2lmpRUJx9V2wflRwOuZ+daSKW6pJbU3AhV/huKHUZMkxiSDIoy+0mN5UKXN84/O7\nbtNCbi4c+8LHloOyM2apTHHjPS9aWqiGXb9GAT8iu6KpUq3cftUnWHMz0oryqfN9\n1VRotxdh+lUemXAC5pTMdhQNx6aaJlVrkI/879x2MblcoWkfJ7HApAsYmDcCAwEA\nAQKCAgADqTzEr8aibG8yBBZEcoyfTKuQaPpysyN2JUMEAvFHi6SeBij589Jn75ou\n8SvjA9KFPfXA8aysCz3kpBUqpeEEgdLPmIRO9M3qDlhDRb00tIk0qTI93elK0ov/\nhQG99aZ8iCGJv0+l0DIhEjWBmjX5ysjLGvwKSenyGOqDvPGgEIfdANeLaxzTqYVP\nWca97Kgw6ZxgrrFtvOtZ9mGKE8oy/0F8fGH5D7Zo9BNa3ywSZbRWPYUsS9PVOsga\n+6WJgeOnfj7cVZ5HdrydcHwnl9zYYdH7/QmCmjcXRCxfwaMjGr7bNf0zb6HkF5sC\na2QiN+k/go3yx2rwQu5f8XGzQLa5QZH+Cj5K+xrjmJPYRPvyvoUylVcwQ0lE5+If\nUA5WQsw+DvhTeuJknwuBWIfeZ8mfY7r+G4w81W8MfJL3y5k3Aqe0qo+DRWtoM5du\nL1OKCIpgjofWpPmUlRCgCipXLH8qEM9CYg3nJ3771Q+vkjlsrDEtf4W6OsJE4GPi\n/T2puPGfOrZQOfAxvJ87AQ6pSXrkFHHkF2zaXqzjwjZH3J0I5WCmzITWpi9s++OI\npzcR+Ym3NtpS003gqIEsuxAZibvvwWRHvNrcxm1+goomHGchEos1xfPvlFB3DV0q\nBT6TtkmednikgA5VdKzncBtgiqORIch620IH6DJ1q01BKYFjSQKCAQEA2FfoHx7O\n+ydD/XDr2E9ycf12BE5dFKExKQ2h71mThBNhiSovRL+JggoSoGYkwzO5NN7TzWzS\nAGf7kSIFEdghBU5WmFteK61u5iYwOubQfepMk3fVhZsRiC2RqYT0BUYk4zAClw+e\nl6gXtMweF8EE2khEEXbEAnqLBHViCYPpYG+y7mJrXLps+2d5uMxaPf3O5wHwjxe6\nY9xn6iROnkUOt9ARB2wdWzp+Ycq/LQ8HHi/uAZ82Jw+h7HWMgFvTn+5C+VXXh2SO\nz0yJ/SanP+tQJ++ejo1rT/kUCx88tsCx3bd9sN3goSPEq+FIprEYkt3UXS287oPA\n+JQFl3johpGYyQKCAQEAt5BE2mFOfA0b5VlsqtC2ca9VFUaAU/Hnd6HQqwVn+CvP\nKLwNsetNpcZrBCxtmtHRvmYUMC2isvtVd617MzGTj4q5ImOOgpro5SvOS9WmuUdy\npL/lMRUxYr3XyWmNWnRvN8wxQ4p+dT74i0WRgZodqzDdlj886FJbU6iQbYFyYE6P\nB+zx9UAnnf01D6Nj9oNGtZz8sLeTdnyi9zxtuIU637MVkFPkRovsI0u1Xl6J92Cu\nASmFkALEfmP2r1pKQvtnp5izIA1L6B4X5Np3eiZJAfUjd1OAeB9vPMDl1kcanyqY\nubVjERcDStZf9N7fqfMRrIhSRskxGzoJf0XRiaIo/wKCAQEAoC297ES4RRYWbfCM\nfjScbK+YEKogmqSaLGYujnOJGBHtdkwogUM7QW/JyL6321tRdkbBFOjMN4bFqPhC\nPqsCD9anoNiNSdN4N6jwrru0hHXUSp9AFVLx0RzEK3oH3lvH9fnXAReMeYb4PmGe\nqkG8IQ2+cBu6Foe6pAtxEdB8G224Um3GRfq1tBIx+lQ7QIjKBxnVjWypEUTgH2jQ\nWLiSpB/Ga/NtbN1LM4aUs3zb7UrZcpP52UPmxJdn9qWGc3RKXCdlk5YtcmieBjP3\nQwkr6NWuVKd6W9T0NSPkpP7Y8mroAerVZRmBhS0gyGJ46kyZ7n9t0j70wld+KF9Z\n8kCcmQKCAQBIVtd7hCts4bGjoakca+HqTWFnYABElKlWUPOt4hSGDaW29N0kx4kz\nEk2sOGH9SECzGwFLt0BN7pRQ9JH/q8LuJ4osDjXkLG4pmijTY+AvVgPM/z6wKBzt\nP8lhO3KUOhx2TccASfzp8aX7JLBh9b1JcJlyk3tKRuJsxpocPY44e90MD4mOz/iM\n33NgtVA4nqVn/vTqI34+jIGgkzTeKcr4y1dtKFJmps+pXTWdef4++d+434ceKKkM\n8hIOKrPnT7IaryewMu0+DVX3P00kWyAcYGHYrZSMQj8RHye0WRMZtKy5Ss0+t+X5\nQSBRnN9h10OYzaQ29ySeCTIi8P3RkpE7AoIBAE4wD+ZZ4aNxVNbnL7zANJ5pVnPw\n+7oMCGOCN5LG86pCix6Gb71tmPWPrnT9OPAIsp4608/i53qUwDQ3VOP2Q/wm3p/V\nnulM2W/3b9P7TUZWvGVsSU9tFdcjU+c4OpmtwzLNoy2n5904Jkd4+TUKKQLClgF5\n60jHnRFl2DeikAZtGi9pHCM7HCUnlBbMHXvK5h0IGF/SImU0VUXRvSeKnT1c9bQP\nWdAnD4oMV7gO8BuQr0icZNDDY5enFEh3o/jSIJjHlS3uogy8T8YKGKiaqXTm8ryt\nLm0p/nwp9jUWk7oxIS7CgeL4RZwVlnNSt2L4+umhOY+T0792+58Tq6jgibs=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-17T11:00:39.985 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-17T11:00:40.706 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:40 smithi066 bash[19869]: audit 2024-09-17T11:00:39.426275+0000 mgr.x (mgr.14152) 9 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:40.706 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:40 smithi066 bash[19869]: audit 2024-09-17T11:00:39.426275+0000 mgr.x (mgr.14152) 9 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:40.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:40 smithi066 bash[19869]: audit 2024-09-17T11:00:39.431356+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:40.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:40 smithi066 bash[19869]: audit 2024-09-17T11:00:39.431356+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:41.907 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-17T11:00:41.908 INFO:teuthology.orchestra.run.smithi066.stdout:Creating initial admin user... 2024-09-17T11:00:41.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:41 smithi066 bash[19869]: audit 2024-09-17T11:00:40.668687+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:41.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:41 smithi066 bash[19869]: audit 2024-09-17T11:00:40.668687+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:41.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:41 smithi066 bash[19869]: audit 2024-09-17T11:00:41.309663+0000 mgr.x (mgr.14152) 10 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:41.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:41 smithi066 bash[19869]: audit 2024-09-17T11:00:41.309663+0000 mgr.x (mgr.14152) 10 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:41.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:41 smithi066 bash[19869]: audit 2024-09-17T11:00:41.312233+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:41.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:41 smithi066 bash[19869]: audit 2024-09-17T11:00:41.312233+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:43.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:42 smithi066 bash[19869]: audit 2024-09-17T11:00:41.776562+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:43.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:42 smithi066 bash[19869]: audit 2024-09-17T11:00:41.776562+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:44.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:43 smithi066 bash[19869]: audit 2024-09-17T11:00:43.399309+0000 mgr.x (mgr.14152) 11 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:44.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:43 smithi066 bash[19869]: audit 2024-09-17T11:00:43.399309+0000 mgr.x (mgr.14152) 11 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:00:44.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:43 smithi066 bash[19869]: audit 2024-09-17T11:00:43.729339+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:44.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:43 smithi066 bash[19869]: audit 2024-09-17T11:00:43.729339+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:44.289 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$yrfmL8POF8erVzm55voetu6c.LN8.WMlkaVXwEBA3AaV2rRPOzapm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726570843, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-17T11:00:44.289 INFO:teuthology.orchestra.run.smithi066.stdout:Fetching dashboard port number... 2024-09-17T11:00:45.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:45 smithi066 bash[19869]: cluster 2024-09-17T11:00:44.883904+0000 mon.a (mon.0) 96 : cluster [DBG] mgrmap e14: x(active, since 12s) 2024-09-17T11:00:45.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:45 smithi066 bash[19869]: cluster 2024-09-17T11:00:44.883904+0000 mon.a (mon.0) 96 : cluster [DBG] mgrmap e14: x(active, since 12s) 2024-09-17T11:00:45.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:45 smithi066 bash[19869]: audit 2024-09-17T11:00:45.625874+0000 mon.a (mon.0) 97 : audit [DBG] from='client.? 172.21.15.66:0/80272158' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-17T11:00:45.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:45 smithi066 bash[19869]: audit 2024-09-17T11:00:45.625874+0000 mon.a (mon.0) 97 : audit [DBG] from='client.? 172.21.15.66:0/80272158' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-17T11:00:46.163 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 8443 2024-09-17T11:00:46.164 INFO:teuthology.orchestra.run.smithi066.stdout:firewalld does not appear to be present 2024-09-17T11:00:46.164 INFO:teuthology.orchestra.run.smithi066.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-17T11:00:46.166 INFO:teuthology.orchestra.run.smithi066.stdout:Ceph Dashboard is now available at: 2024-09-17T11:00:46.166 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:00:46.166 INFO:teuthology.orchestra.run.smithi066.stdout: URL: https://smithi066.front.sepia.ceph.com:8443/ 2024-09-17T11:00:46.166 INFO:teuthology.orchestra.run.smithi066.stdout: User: admin 2024-09-17T11:00:46.166 INFO:teuthology.orchestra.run.smithi066.stdout: Password: zxmrtyiihg 2024-09-17T11:00:46.166 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:00:46.166 INFO:teuthology.orchestra.run.smithi066.stdout:Saving cluster configuration to /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/config directory 2024-09-17T11:00:48.986 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-17T11:00:48.986 INFO:teuthology.orchestra.run.smithi066.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-17T11:00:48.986 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:00:48.986 INFO:teuthology.orchestra.run.smithi066.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-17T11:00:48.986 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:00:48.987 INFO:teuthology.orchestra.run.smithi066.stdout:Or, if you are only running a single cluster on this host: 2024-09-17T11:00:48.987 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:00:48.987 INFO:teuthology.orchestra.run.smithi066.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-17T11:00:48.987 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:00:48.987 INFO:teuthology.orchestra.run.smithi066.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-17T11:00:48.987 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:00:48.987 INFO:teuthology.orchestra.run.smithi066.stdout: ceph telemetry on 2024-09-17T11:00:48.987 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:00:48.987 INFO:teuthology.orchestra.run.smithi066.stdout:For more information see: 2024-09-17T11:00:48.987 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:00:48.987 INFO:teuthology.orchestra.run.smithi066.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-17T11:00:48.987 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:00:48.987 INFO:teuthology.orchestra.run.smithi066.stdout:Bootstrap complete. 2024-09-17T11:00:49.048 INFO:tasks.cephadm:Fetching config... 2024-09-17T11:00:49.048 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-17T11:00:49.048 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-17T11:00:49.054 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-17T11:00:49.054 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-17T11:00:49.054 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-17T11:00:49.104 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-17T11:00:49.104 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-17T11:00:49.104 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-17T11:00:49.158 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-17T11:00:49.158 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-17T11:00:49.158 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-17T11:00:49.208 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-17T11:00:49.209 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCKcAqQlW4JvocSXcGT9vLE8ueoZ5/QArE74KT9HNZREpnRCPI8DYKW5/pXVE9/Epi9Aoh/cENOgbDxs9TkJcrkG/1ZIB4JjcyFvcRXDL6LUcwWsg1DPCcn0DyxODgyCK2w6lzegmcogJ6rthEkaCbwYhYSonYYLf1mU2uHkI8JXhZqaSFa0tSzIDdVVXgix7EqqH+eCGxXX8FfO6w3Mq4XOlVhmszLMbgjh1sSUAr04MV0JtvKZb1Zsw/9rrEXd+bCe+as0VYucJNliMPJKQSC+ub6IkvaqSHErvJImU6KM2rUeE+mRCoFF/W7TPGfU7KgnvF2deBSawvMrBjOQzfu8p94YAW5ip2SOb31diyZeA7RYYXrKRiPPnZWeqNMRiwIDL5E7a/1rDRQ1zO4smunLCaPmtyTAJ5UtnrFLmmxbQ10y49kFBpL5STdXm75unidBEx8BEuQZJ4lyYKareitb/UsARC1hbmMPdP9AgmDpVrfKjwiOiuD3S9B4FO/x7M= ceph-b966aac8-74e3-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T11:00:49.275 INFO:teuthology.orchestra.run.smithi066.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCKcAqQlW4JvocSXcGT9vLE8ueoZ5/QArE74KT9HNZREpnRCPI8DYKW5/pXVE9/Epi9Aoh/cENOgbDxs9TkJcrkG/1ZIB4JjcyFvcRXDL6LUcwWsg1DPCcn0DyxODgyCK2w6lzegmcogJ6rthEkaCbwYhYSonYYLf1mU2uHkI8JXhZqaSFa0tSzIDdVVXgix7EqqH+eCGxXX8FfO6w3Mq4XOlVhmszLMbgjh1sSUAr04MV0JtvKZb1Zsw/9rrEXd+bCe+as0VYucJNliMPJKQSC+ub6IkvaqSHErvJImU6KM2rUeE+mRCoFF/W7TPGfU7KgnvF2deBSawvMrBjOQzfu8p94YAW5ip2SOb31diyZeA7RYYXrKRiPPnZWeqNMRiwIDL5E7a/1rDRQ1zO4smunLCaPmtyTAJ5UtnrFLmmxbQ10y49kFBpL5STdXm75unidBEx8BEuQZJ4lyYKareitb/UsARC1hbmMPdP9AgmDpVrfKjwiOiuD3S9B4FO/x7M= ceph-b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T11:00:49.285 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCKcAqQlW4JvocSXcGT9vLE8ueoZ5/QArE74KT9HNZREpnRCPI8DYKW5/pXVE9/Epi9Aoh/cENOgbDxs9TkJcrkG/1ZIB4JjcyFvcRXDL6LUcwWsg1DPCcn0DyxODgyCK2w6lzegmcogJ6rthEkaCbwYhYSonYYLf1mU2uHkI8JXhZqaSFa0tSzIDdVVXgix7EqqH+eCGxXX8FfO6w3Mq4XOlVhmszLMbgjh1sSUAr04MV0JtvKZb1Zsw/9rrEXd+bCe+as0VYucJNliMPJKQSC+ub6IkvaqSHErvJImU6KM2rUeE+mRCoFF/W7TPGfU7KgnvF2deBSawvMrBjOQzfu8p94YAW5ip2SOb31diyZeA7RYYXrKRiPPnZWeqNMRiwIDL5E7a/1rDRQ1zO4smunLCaPmtyTAJ5UtnrFLmmxbQ10y49kFBpL5STdXm75unidBEx8BEuQZJ4lyYKareitb/UsARC1hbmMPdP9AgmDpVrfKjwiOiuD3S9B4FO/x7M= ceph-b966aac8-74e3-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T11:00:49.308 INFO:teuthology.orchestra.run.smithi161.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCKcAqQlW4JvocSXcGT9vLE8ueoZ5/QArE74KT9HNZREpnRCPI8DYKW5/pXVE9/Epi9Aoh/cENOgbDxs9TkJcrkG/1ZIB4JjcyFvcRXDL6LUcwWsg1DPCcn0DyxODgyCK2w6lzegmcogJ6rthEkaCbwYhYSonYYLf1mU2uHkI8JXhZqaSFa0tSzIDdVVXgix7EqqH+eCGxXX8FfO6w3Mq4XOlVhmszLMbgjh1sSUAr04MV0JtvKZb1Zsw/9rrEXd+bCe+as0VYucJNliMPJKQSC+ub6IkvaqSHErvJImU6KM2rUeE+mRCoFF/W7TPGfU7KgnvF2deBSawvMrBjOQzfu8p94YAW5ip2SOb31diyZeA7RYYXrKRiPPnZWeqNMRiwIDL5E7a/1rDRQ1zO4smunLCaPmtyTAJ5UtnrFLmmxbQ10y49kFBpL5STdXm75unidBEx8BEuQZJ4lyYKareitb/UsARC1hbmMPdP9AgmDpVrfKjwiOiuD3S9B4FO/x7M= ceph-b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T11:00:49.312 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:49 smithi066 bash[19869]: audit 2024-09-17T11:00:48.277639+0000 mon.a (mon.0) 98 : audit [INF] from='client.? 172.21.15.66:0/2643899150' entity='client.admin' 2024-09-17T11:00:49.312 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:49 smithi066 bash[19869]: audit 2024-09-17T11:00:48.277639+0000 mon.a (mon.0) 98 : audit [INF] from='client.? 172.21.15.66:0/2643899150' entity='client.admin' 2024-09-17T11:00:49.317 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-17T11:00:52.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:52 smithi066 bash[19869]: audit 2024-09-17T11:00:51.578858+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:52.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:52 smithi066 bash[19869]: audit 2024-09-17T11:00:51.578858+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:52.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:52 smithi066 bash[19869]: audit 2024-09-17T11:00:51.583969+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:52.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:52 smithi066 bash[19869]: audit 2024-09-17T11:00:51.583969+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:52.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:52 smithi066 bash[19869]: audit 2024-09-17T11:00:51.585660+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"} : dispatch 2024-09-17T11:00:52.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:52 smithi066 bash[19869]: audit 2024-09-17T11:00:51.585660+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"} : dispatch 2024-09-17T11:00:52.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:52 smithi066 bash[19869]: audit 2024-09-17T11:00:51.592685+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:52.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:52 smithi066 bash[19869]: audit 2024-09-17T11:00:51.592685+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:52.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:52 smithi066 bash[19869]: audit 2024-09-17T11:00:51.611758+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:00:52.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:52 smithi066 bash[19869]: audit 2024-09-17T11:00:51.611758+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:00:52.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:52 smithi066 bash[19869]: audit 2024-09-17T11:00:51.621014+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:52.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:52 smithi066 bash[19869]: audit 2024-09-17T11:00:51.621014+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:53.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:53 smithi066 bash[19869]: cluster 2024-09-17T11:00:52.757347+0000 mgr.x (mgr.14152) 12 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:53.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:53 smithi066 bash[19869]: cluster 2024-09-17T11:00:52.757347+0000 mgr.x (mgr.14152) 12 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:54.053 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:00:56.117 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-17T11:00:56.118 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-17T11:00:56.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:56 smithi066 bash[19869]: cluster 2024-09-17T11:00:54.757794+0000 mgr.x (mgr.14152) 13 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:56.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:56 smithi066 bash[19869]: cluster 2024-09-17T11:00:54.757794+0000 mgr.x (mgr.14152) 13 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:56.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:56 smithi066 bash[19869]: audit 2024-09-17T11:00:55.515241+0000 mon.a (mon.0) 105 : audit [INF] from='client.? 172.21.15.66:0/2766268765' entity='client.admin' 2024-09-17T11:00:56.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:56 smithi066 bash[19869]: audit 2024-09-17T11:00:55.515241+0000 mon.a (mon.0) 105 : audit [INF] from='client.? 172.21.15.66:0/2766268765' entity='client.admin' 2024-09-17T11:00:56.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:56 smithi066 bash[19869]: audit 2024-09-17T11:00:55.532372+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:00:56.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:56 smithi066 bash[19869]: audit 2024-09-17T11:00:55.532372+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:00:56.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:56 smithi066 bash[19869]: audit 2024-09-17T11:00:55.536992+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:56.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:56 smithi066 bash[19869]: audit 2024-09-17T11:00:55.536992+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:00:57.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:57 smithi066 bash[19869]: cluster 2024-09-17T11:00:56.758243+0000 mgr.x (mgr.14152) 14 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:00:57.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:57 smithi066 bash[19869]: cluster 2024-09-17T11:00:56.758243+0000 mgr.x (mgr.14152) 14 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:00.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:59 smithi066 bash[19869]: cluster 2024-09-17T11:00:58.758658+0000 mgr.x (mgr.14152) 15 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:00.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:00:59 smithi066 bash[19869]: cluster 2024-09-17T11:00:58.758658+0000 mgr.x (mgr.14152) 15 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:00.848 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:01:02.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:01 smithi066 bash[19869]: cluster 2024-09-17T11:01:00.759127+0000 mgr.x (mgr.14152) 16 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:02.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:01 smithi066 bash[19869]: cluster 2024-09-17T11:01:00.759127+0000 mgr.x (mgr.14152) 16 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:02.837 INFO:tasks.cephadm:Remote smithi161 excluded from cephadm cluster by role 2024-09-17T11:01:02.837 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-17T11:01:02.838 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-17T11:01:03.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.220239+0000 mgr.x (mgr.14152) 17 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:01:03.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.220239+0000 mgr.x (mgr.14152) 17 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:01:03.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.228007+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:03.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.228007+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:03.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.229120+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:01:03.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.229120+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:01:03.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.231340+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:01:03.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.231340+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:01:03.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.232239+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:01:03.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.232239+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:01:03.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: cephadm 2024-09-17T11:01:02.233503+0000 mgr.x (mgr.14152) 18 : cephadm [INF] Updating smithi066:/etc/ceph/ceph.conf 2024-09-17T11:01:03.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: cephadm 2024-09-17T11:01:02.233503+0000 mgr.x (mgr.14152) 18 : cephadm [INF] Updating smithi066:/etc/ceph/ceph.conf 2024-09-17T11:01:03.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: cephadm 2024-09-17T11:01:02.295921+0000 mgr.x (mgr.14152) 19 : cephadm [INF] Updating smithi066:/var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T11:01:03.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: cephadm 2024-09-17T11:01:02.295921+0000 mgr.x (mgr.14152) 19 : cephadm [INF] Updating smithi066:/var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T11:01:03.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: cephadm 2024-09-17T11:01:02.348561+0000 mgr.x (mgr.14152) 20 : cephadm [INF] Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-17T11:01:03.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: cephadm 2024-09-17T11:01:02.348561+0000 mgr.x (mgr.14152) 20 : cephadm [INF] Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-17T11:01:03.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: cephadm 2024-09-17T11:01:02.403084+0000 mgr.x (mgr.14152) 21 : cephadm [INF] Updating smithi066:/var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T11:01:03.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: cephadm 2024-09-17T11:01:02.403084+0000 mgr.x (mgr.14152) 21 : cephadm [INF] Updating smithi066:/var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T11:01:03.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.464795+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:03.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.464795+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:03.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.470007+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:03.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.470007+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:03.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.475579+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:03.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:03 smithi066 bash[19869]: audit 2024-09-17T11:01:02.475579+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:04.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:04 smithi066 bash[19869]: cluster 2024-09-17T11:01:02.759534+0000 mgr.x (mgr.14152) 22 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:04.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:04 smithi066 bash[19869]: cluster 2024-09-17T11:01:02.759534+0000 mgr.x (mgr.14152) 22 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:06.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:06 smithi066 bash[19869]: cluster 2024-09-17T11:01:04.759983+0000 mgr.x (mgr.14152) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:06.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:06 smithi066 bash[19869]: cluster 2024-09-17T11:01:04.759983+0000 mgr.x (mgr.14152) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:07.570 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:01:08.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:08 smithi066 bash[19869]: cluster 2024-09-17T11:01:06.760378+0000 mgr.x (mgr.14152) 24 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:08.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:08 smithi066 bash[19869]: cluster 2024-09-17T11:01:06.760378+0000 mgr.x (mgr.14152) 24 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:09.490 INFO:teuthology.orchestra.run.smithi066.stderr:adjusted tunables profile to default 2024-09-17T11:01:09.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:09 smithi066 bash[19869]: audit 2024-09-17T11:01:08.922657+0000 mon.a (mon.0) 115 : audit [INF] from='client.? 172.21.15.66:0/1099116955' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-17T11:01:09.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:09 smithi066 bash[19869]: audit 2024-09-17T11:01:08.922657+0000 mon.a (mon.0) 115 : audit [INF] from='client.? 172.21.15.66:0/1099116955' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-17T11:01:10.051 INFO:tasks.cephadm:Adding mon.a on smithi066 2024-09-17T11:01:10.051 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph orch apply mon '1;smithi066:172.21.15.66=a' 2024-09-17T11:01:10.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:10 smithi066 bash[19869]: cluster 2024-09-17T11:01:08.760657+0000 mgr.x (mgr.14152) 25 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:10.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:10 smithi066 bash[19869]: cluster 2024-09-17T11:01:08.760657+0000 mgr.x (mgr.14152) 25 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:10.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:10 smithi066 bash[19869]: audit 2024-09-17T11:01:09.489848+0000 mon.a (mon.0) 116 : audit [INF] from='client.? 172.21.15.66:0/1099116955' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T11:01:10.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:10 smithi066 bash[19869]: audit 2024-09-17T11:01:09.489848+0000 mon.a (mon.0) 116 : audit [INF] from='client.? 172.21.15.66:0/1099116955' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T11:01:10.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:10 smithi066 bash[19869]: cluster 2024-09-17T11:01:09.495623+0000 mon.a (mon.0) 117 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-17T11:01:10.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:10 smithi066 bash[19869]: cluster 2024-09-17T11:01:09.495623+0000 mon.a (mon.0) 117 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-17T11:01:12.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:12 smithi066 bash[19869]: cluster 2024-09-17T11:01:10.761107+0000 mgr.x (mgr.14152) 26 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:12.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:12 smithi066 bash[19869]: cluster 2024-09-17T11:01:10.761107+0000 mgr.x (mgr.14152) 26 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:14.776 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:01:14.870 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:14 smithi066 bash[19869]: cluster 2024-09-17T11:01:12.761572+0000 mgr.x (mgr.14152) 27 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:14.871 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:14 smithi066 bash[19869]: cluster 2024-09-17T11:01:12.761572+0000 mgr.x (mgr.14152) 27 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:16.214 INFO:teuthology.orchestra.run.smithi066.stdout:Scheduled mon update... 2024-09-17T11:01:16.889 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: cluster 2024-09-17T11:01:14.762017+0000 mgr.x (mgr.14152) 28 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:16.889 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: cluster 2024-09-17T11:01:14.762017+0000 mgr.x (mgr.14152) 28 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:16.889 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.212966+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:16.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.212966+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:16.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.214056+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:01:16.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.214056+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:01:16.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.216033+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:01:16.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.216033+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:01:16.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.217323+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:01:16.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.217323+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:01:16.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.224202+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:16.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.224202+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:16.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.228552+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:16.890 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.228552+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:16.891 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.241353+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:16.891 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.241353+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:16.891 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.243136+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:16.891 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.243136+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:16.891 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.244844+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:16.891 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.244844+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:16.891 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.246550+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:16.891 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.246550+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:16.891 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.247123+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-17T11:01:16.891 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.247123+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-17T11:01:16.891 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.247770+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-17T11:01:16.891 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.247770+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-17T11:01:16.892 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.248447+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:01:16.892 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:16 smithi066 bash[19869]: audit 2024-09-17T11:01:16.248447+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:01:17.011 INFO:tasks.cephadm:Waiting for 1 mons in monmap... 2024-09-17T11:01:17.011 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T11:01:17.758 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:17 smithi066 bash[19869]: audit 2024-09-17T11:01:16.206496+0000 mgr.x (mgr.14152) 29 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "1;smithi066:172.21.15.66=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:01:17.758 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:17 smithi066 bash[19869]: audit 2024-09-17T11:01:16.206496+0000 mgr.x (mgr.14152) 29 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "1;smithi066:172.21.15.66=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:01:17.758 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:17 smithi066 bash[19869]: cephadm 2024-09-17T11:01:16.208602+0000 mgr.x (mgr.14152) 30 : cephadm [INF] Saving service mon spec with placement smithi066:172.21.15.66=a;count:1 2024-09-17T11:01:17.758 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:17 smithi066 bash[19869]: cephadm 2024-09-17T11:01:16.208602+0000 mgr.x (mgr.14152) 30 : cephadm [INF] Saving service mon spec with placement smithi066:172.21.15.66=a;count:1 2024-09-17T11:01:17.758 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:17 smithi066 bash[19869]: cephadm 2024-09-17T11:01:16.246849+0000 mgr.x (mgr.14152) 31 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-17T11:01:17.758 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:17 smithi066 bash[19869]: cephadm 2024-09-17T11:01:16.246849+0000 mgr.x (mgr.14152) 31 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-17T11:01:17.758 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:17 smithi066 bash[19869]: cephadm 2024-09-17T11:01:16.249177+0000 mgr.x (mgr.14152) 32 : cephadm [INF] Reconfiguring daemon mon.a on smithi066 2024-09-17T11:01:17.758 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:17 smithi066 bash[19869]: cephadm 2024-09-17T11:01:16.249177+0000 mgr.x (mgr.14152) 32 : cephadm [INF] Reconfiguring daemon mon.a on smithi066 2024-09-17T11:01:18.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:18 smithi066 bash[19869]: cluster 2024-09-17T11:01:16.762396+0000 mgr.x (mgr.14152) 33 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:18 smithi066 bash[19869]: cluster 2024-09-17T11:01:16.762396+0000 mgr.x (mgr.14152) 33 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:18 smithi066 bash[19869]: audit 2024-09-17T11:01:18.450001+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:18 smithi066 bash[19869]: audit 2024-09-17T11:01:18.450001+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:18 smithi066 bash[19869]: audit 2024-09-17T11:01:18.456240+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:18 smithi066 bash[19869]: audit 2024-09-17T11:01:18.456240+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:20.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:20 smithi066 bash[19869]: cluster 2024-09-17T11:01:18.762756+0000 mgr.x (mgr.14152) 34 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:20.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:20 smithi066 bash[19869]: cluster 2024-09-17T11:01:18.762756+0000 mgr.x (mgr.14152) 34 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:21.746 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:01:22.773 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:22 smithi066 bash[19869]: cluster 2024-09-17T11:01:20.763176+0000 mgr.x (mgr.14152) 35 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:22.773 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:22 smithi066 bash[19869]: cluster 2024-09-17T11:01:20.763176+0000 mgr.x (mgr.14152) 35 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:23.173 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:01:23.173 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":1,"fsid":"b966aac8-74e3-11ef-bceb-c7b262605968","modified":"2024-09-17T10:59:22.724865Z","created":"2024-09-17T10:59:22.724865Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T11:01:23.173 INFO:teuthology.orchestra.run.smithi066.stderr:dumped monmap epoch 1 2024-09-17T11:01:23.816 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:23 smithi066 bash[19869]: audit 2024-09-17T11:01:23.172285+0000 mon.a (mon.0) 133 : audit [DBG] from='client.? 172.21.15.66:0/1088149277' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-17T11:01:23.816 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:23 smithi066 bash[19869]: audit 2024-09-17T11:01:23.172285+0000 mon.a (mon.0) 133 : audit [DBG] from='client.? 172.21.15.66:0/1088149277' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-17T11:01:23.817 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-17T11:01:23.818 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-17T11:01:24.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:24 smithi066 bash[19869]: cluster 2024-09-17T11:01:22.763580+0000 mgr.x (mgr.14152) 36 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:24.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:24 smithi066 bash[19869]: cluster 2024-09-17T11:01:22.763580+0000 mgr.x (mgr.14152) 36 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:26.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:26 smithi066 bash[19869]: cluster 2024-09-17T11:01:24.764034+0000 mgr.x (mgr.14152) 37 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:26.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:26 smithi066 bash[19869]: cluster 2024-09-17T11:01:24.764034+0000 mgr.x (mgr.14152) 37 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:28.551 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:01:28.956 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:28 smithi066 bash[19869]: cluster 2024-09-17T11:01:26.764489+0000 mgr.x (mgr.14152) 38 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:28.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:28 smithi066 bash[19869]: cluster 2024-09-17T11:01:26.764489+0000 mgr.x (mgr.14152) 38 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:29.959 INFO:teuthology.orchestra.run.smithi066.stdout:# minimal ceph.conf for b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T11:01:29.959 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2024-09-17T11:01:29.959 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T11:01:29.960 INFO:teuthology.orchestra.run.smithi066.stdout: mon_host = [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] 2024-09-17T11:01:30.548 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-17T11:01:30.548 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-17T11:01:30.548 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T11:01:30.562 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-17T11:01:30.562 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T11:01:30.615 INFO:tasks.cephadm:Adding mgr.x on smithi066 2024-09-17T11:01:30.616 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph orch apply mgr '1;smithi066=x' 2024-09-17T11:01:30.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:30 smithi066 bash[19869]: cluster 2024-09-17T11:01:28.764931+0000 mgr.x (mgr.14152) 39 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:30.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:30 smithi066 bash[19869]: cluster 2024-09-17T11:01:28.764931+0000 mgr.x (mgr.14152) 39 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:30.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:30 smithi066 bash[19869]: audit 2024-09-17T11:01:29.958209+0000 mon.a (mon.0) 134 : audit [DBG] from='client.? 172.21.15.66:0/3531898930' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:01:30.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:30 smithi066 bash[19869]: audit 2024-09-17T11:01:29.958209+0000 mon.a (mon.0) 134 : audit [DBG] from='client.? 172.21.15.66:0/3531898930' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:01:31.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:31 smithi066 bash[19869]: cluster 2024-09-17T11:01:30.765335+0000 mgr.x (mgr.14152) 40 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:31.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:31 smithi066 bash[19869]: cluster 2024-09-17T11:01:30.765335+0000 mgr.x (mgr.14152) 40 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:34.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:33 smithi066 bash[19869]: cluster 2024-09-17T11:01:32.765768+0000 mgr.x (mgr.14152) 41 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:34.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:33 smithi066 bash[19869]: cluster 2024-09-17T11:01:32.765768+0000 mgr.x (mgr.14152) 41 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:01:36.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:35 smithi066 bash[19869]: cluster 2024-09-17T11:01:34.766237+0000 mgr.x (mgr.14152) 42 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:36.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:35 smithi066 bash[19869]: cluster 2024-09-17T11:01:34.766237+0000 mgr.x (mgr.14152) 42 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:36.815 INFO:teuthology.orchestra.run.smithi066.stdout:Scheduled mgr update... 2024-09-17T11:01:37.438 DEBUG:tasks.cephadm:set 0 configs 2024-09-17T11:01:37.439 INFO:tasks.cephadm:Deploying OSDs... 2024-09-17T11:01:37.439 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-17T11:01:37.439 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T11:01:37.444 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T11:01:37.444 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 2024-09-17T11:01:37.493 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T11:01:37.493 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T11:01:37.493 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-09-17T11:01:37.493 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T11:01:37.493 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-17 10:54:15.215612898 +0000 2024-09-17T11:01:37.493 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-17 10:54:14.947615292 +0000 2024-09-17T11:01:37.493 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-17 10:54:14.947615292 +0000 2024-09-17T11:01:37.493 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2024-09-17T11:01:37.494 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T11:01:37.550 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-17T11:01:37.550 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-17T11:01:37.550 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000359267 s, 1.4 MB/s 2024-09-17T11:01:37.551 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T11:01:37.598 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 2024-09-17T11:01:37.645 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T11:01:37.645 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T11:01:37.645 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-09-17T11:01:37.645 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T11:01:37.645 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-17 10:54:15.491610433 +0000 2024-09-17T11:01:37.645 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-17 10:54:15.487610469 +0000 2024-09-17T11:01:37.645 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-17 10:54:15.487610469 +0000 2024-09-17T11:01:37.645 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2024-09-17T11:01:37.646 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T11:01:37.698 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-17T11:01:37.698 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-17T11:01:37.699 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.00037693 s, 1.4 MB/s 2024-09-17T11:01:37.699 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T11:01:37.750 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 2024-09-17T11:01:37.797 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T11:01:37.797 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T11:01:37.797 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-09-17T11:01:37.797 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T11:01:37.797 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-17 10:54:16.263603537 +0000 2024-09-17T11:01:37.797 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-17 10:54:16.015605752 +0000 2024-09-17T11:01:37.797 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-17 10:54:16.015605752 +0000 2024-09-17T11:01:37.797 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2024-09-17T11:01:37.798 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T11:01:37.852 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-17T11:01:37.852 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-17T11:01:37.852 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.00042641 s, 1.2 MB/s 2024-09-17T11:01:37.853 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T11:01:37.902 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 2024-09-17T11:01:37.953 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T11:01:37.953 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T11:01:37.953 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-09-17T11:01:37.953 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T11:01:37.953 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-17 10:54:16.767599035 +0000 2024-09-17T11:01:37.953 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-17 10:54:16.519601251 +0000 2024-09-17T11:01:37.953 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-17 10:54:16.519601251 +0000 2024-09-17T11:01:37.953 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2024-09-17T11:01:37.954 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T11:01:37.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: cluster 2024-09-17T11:01:36.766696+0000 mgr.x (mgr.14152) 43 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:37.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: cluster 2024-09-17T11:01:36.766696+0000 mgr.x (mgr.14152) 43 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:37.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.807761+0000 mgr.x (mgr.14152) 44 : audit [DBG] from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;smithi066=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:01:37.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.807761+0000 mgr.x (mgr.14152) 44 : audit [DBG] from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;smithi066=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:01:37.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: cephadm 2024-09-17T11:01:36.809542+0000 mgr.x (mgr.14152) 45 : cephadm [INF] Saving service mgr spec with placement smithi066=x;count:1 2024-09-17T11:01:37.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: cephadm 2024-09-17T11:01:36.809542+0000 mgr.x (mgr.14152) 45 : cephadm [INF] Saving service mgr spec with placement smithi066=x;count:1 2024-09-17T11:01:37.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.814024+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:37.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.814024+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:37.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.815273+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:01:37.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.815273+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:01:37.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.817906+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:01:37.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.817906+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:01:37.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.818805+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:01:37.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.818805+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:01:37.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.823926+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:37.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.823926+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:37.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.827388+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:37.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.827388+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:37.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: cephadm 2024-09-17T11:01:36.837746+0000 mgr.x (mgr.14152) 46 : cephadm [INF] Reconfiguring mgr.x (unknown last config time)... 2024-09-17T11:01:37.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: cephadm 2024-09-17T11:01:36.837746+0000 mgr.x (mgr.14152) 46 : cephadm [INF] Reconfiguring mgr.x (unknown last config time)... 2024-09-17T11:01:37.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.838392+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-17T11:01:37.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.838392+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-17T11:01:37.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.839464+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-17T11:01:37.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.839464+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-17T11:01:37.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.840428+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:01:37.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: audit 2024-09-17T11:01:36.840428+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:01:37.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: cephadm 2024-09-17T11:01:36.841251+0000 mgr.x (mgr.14152) 47 : cephadm [INF] Reconfiguring daemon mgr.x on smithi066 2024-09-17T11:01:37.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:37 smithi066 bash[19869]: cephadm 2024-09-17T11:01:36.841251+0000 mgr.x (mgr.14152) 47 : cephadm [INF] Reconfiguring daemon mgr.x on smithi066 2024-09-17T11:01:37.971 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-17T11:01:37.971 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-17T11:01:37.971 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.00038224 s, 1.3 MB/s 2024-09-17T11:01:37.972 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T11:01:38.022 INFO:tasks.cephadm:Deploying osd.0 on smithi066 with /dev/vg_nvme/lv_4... 2024-09-17T11:01:38.022 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-17T11:01:40.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:39 smithi066 bash[19869]: cluster 2024-09-17T11:01:38.767115+0000 mgr.x (mgr.14152) 48 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:40.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:39 smithi066 bash[19869]: cluster 2024-09-17T11:01:38.767115+0000 mgr.x (mgr.14152) 48 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:40.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:39 smithi066 bash[19869]: audit 2024-09-17T11:01:38.955057+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:40.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:39 smithi066 bash[19869]: audit 2024-09-17T11:01:38.955057+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:40.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:39 smithi066 bash[19869]: audit 2024-09-17T11:01:38.958753+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:40.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:39 smithi066 bash[19869]: audit 2024-09-17T11:01:38.958753+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:01:42.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:41 smithi066 bash[19869]: cluster 2024-09-17T11:01:40.767534+0000 mgr.x (mgr.14152) 49 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:42.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:41 smithi066 bash[19869]: cluster 2024-09-17T11:01:40.767534+0000 mgr.x (mgr.14152) 49 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:42.795 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:01:44.059 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:43 smithi066 bash[19869]: cluster 2024-09-17T11:01:42.767947+0000 mgr.x (mgr.14152) 50 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:44.060 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:43 smithi066 bash[19869]: cluster 2024-09-17T11:01:42.767947+0000 mgr.x (mgr.14152) 50 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:46.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:45 smithi066 bash[19869]: cluster 2024-09-17T11:01:44.768398+0000 mgr.x (mgr.14152) 51 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:46.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:45 smithi066 bash[19869]: cluster 2024-09-17T11:01:44.768398+0000 mgr.x (mgr.14152) 51 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:46.452 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:01:46.503 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_4 2024-09-17T11:01:48.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:47 smithi066 bash[19869]: cluster 2024-09-17T11:01:46.768850+0000 mgr.x (mgr.14152) 52 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:48.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:47 smithi066 bash[19869]: cluster 2024-09-17T11:01:46.768850+0000 mgr.x (mgr.14152) 52 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:50.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:49 smithi066 bash[19869]: cluster 2024-09-17T11:01:48.769241+0000 mgr.x (mgr.14152) 53 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:50.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:49 smithi066 bash[19869]: cluster 2024-09-17T11:01:48.769241+0000 mgr.x (mgr.14152) 53 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:51.235 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:01:52.274 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:51 smithi066 bash[19869]: cluster 2024-09-17T11:01:50.769728+0000 mgr.x (mgr.14152) 54 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:52.275 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:51 smithi066 bash[19869]: cluster 2024-09-17T11:01:50.769728+0000 mgr.x (mgr.14152) 54 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:53.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:52 smithi066 bash[19869]: audit 2024-09-17T11:01:52.645647+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-17T11:01:53.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:52 smithi066 bash[19869]: audit 2024-09-17T11:01:52.645647+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-17T11:01:53.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:52 smithi066 bash[19869]: audit 2024-09-17T11:01:52.649542+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-17T11:01:53.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:52 smithi066 bash[19869]: audit 2024-09-17T11:01:52.649542+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-17T11:01:53.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:52 smithi066 bash[19869]: audit 2024-09-17T11:01:52.650886+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:01:53.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:52 smithi066 bash[19869]: audit 2024-09-17T11:01:52.650886+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:01:54.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:53 smithi066 bash[19869]: audit 2024-09-17T11:01:52.641660+0000 mgr.x (mgr.14152) 55 : audit [DBG] from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:01:54.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:53 smithi066 bash[19869]: audit 2024-09-17T11:01:52.641660+0000 mgr.x (mgr.14152) 55 : audit [DBG] from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:01:54.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:53 smithi066 bash[19869]: cluster 2024-09-17T11:01:52.770154+0000 mgr.x (mgr.14152) 56 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:54.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:53 smithi066 bash[19869]: cluster 2024-09-17T11:01:52.770154+0000 mgr.x (mgr.14152) 56 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:56.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:55 smithi066 bash[19869]: cluster 2024-09-17T11:01:54.770644+0000 mgr.x (mgr.14152) 57 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:56.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:55 smithi066 bash[19869]: cluster 2024-09-17T11:01:54.770644+0000 mgr.x (mgr.14152) 57 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:58.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:57 smithi066 bash[19869]: cluster 2024-09-17T11:01:56.771026+0000 mgr.x (mgr.14152) 58 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:01:58.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:57 smithi066 bash[19869]: cluster 2024-09-17T11:01:56.771026+0000 mgr.x (mgr.14152) 58 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:00.347 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:59 smithi066 bash[19869]: cluster 2024-09-17T11:01:58.771439+0000 mgr.x (mgr.14152) 59 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:00.347 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:01:59 smithi066 bash[19869]: cluster 2024-09-17T11:01:58.771439+0000 mgr.x (mgr.14152) 59 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:02.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:01 smithi066 bash[19869]: cluster 2024-09-17T11:02:00.771868+0000 mgr.x (mgr.14152) 60 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:02.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:01 smithi066 bash[19869]: cluster 2024-09-17T11:02:00.771868+0000 mgr.x (mgr.14152) 60 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:02.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:01 smithi066 bash[19869]: audit 2024-09-17T11:02:01.102573+0000 mon.a (mon.0) 149 : audit [INF] from='client.? 172.21.15.66:0/143086420' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8e8a9c97-d54a-4fa1-a32e-32ed59700e56"} : dispatch 2024-09-17T11:02:02.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:01 smithi066 bash[19869]: audit 2024-09-17T11:02:01.102573+0000 mon.a (mon.0) 149 : audit [INF] from='client.? 172.21.15.66:0/143086420' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8e8a9c97-d54a-4fa1-a32e-32ed59700e56"} : dispatch 2024-09-17T11:02:02.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:01 smithi066 bash[19869]: audit 2024-09-17T11:02:01.104669+0000 mon.a (mon.0) 150 : audit [INF] from='client.? 172.21.15.66:0/143086420' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e8a9c97-d54a-4fa1-a32e-32ed59700e56"}]': finished 2024-09-17T11:02:02.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:01 smithi066 bash[19869]: audit 2024-09-17T11:02:01.104669+0000 mon.a (mon.0) 150 : audit [INF] from='client.? 172.21.15.66:0/143086420' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e8a9c97-d54a-4fa1-a32e-32ed59700e56"}]': finished 2024-09-17T11:02:02.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:01 smithi066 bash[19869]: cluster 2024-09-17T11:02:01.108441+0000 mon.a (mon.0) 151 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-17T11:02:02.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:01 smithi066 bash[19869]: cluster 2024-09-17T11:02:01.108441+0000 mon.a (mon.0) 151 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-17T11:02:02.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:01 smithi066 bash[19869]: audit 2024-09-17T11:02:01.108803+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T11:02:02.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:01 smithi066 bash[19869]: audit 2024-09-17T11:02:01.108803+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T11:02:02.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:01 smithi066 bash[19869]: audit 2024-09-17T11:02:01.785314+0000 mon.a (mon.0) 153 : audit [DBG] from='client.? 172.21.15.66:0/1813921075' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-17T11:02:02.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:01 smithi066 bash[19869]: audit 2024-09-17T11:02:01.785314+0000 mon.a (mon.0) 153 : audit [DBG] from='client.? 172.21.15.66:0/1813921075' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-17T11:02:04.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:03 smithi066 bash[19869]: cluster 2024-09-17T11:02:02.772217+0000 mgr.x (mgr.14152) 61 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:04.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:03 smithi066 bash[19869]: cluster 2024-09-17T11:02:02.772217+0000 mgr.x (mgr.14152) 61 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:06.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:05 smithi066 bash[19869]: cluster 2024-09-17T11:02:04.772581+0000 mgr.x (mgr.14152) 62 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:06.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:05 smithi066 bash[19869]: cluster 2024-09-17T11:02:04.772581+0000 mgr.x (mgr.14152) 62 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:08.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:07 smithi066 bash[19869]: cluster 2024-09-17T11:02:06.772995+0000 mgr.x (mgr.14152) 63 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:08.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:07 smithi066 bash[19869]: cluster 2024-09-17T11:02:06.772995+0000 mgr.x (mgr.14152) 63 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:10.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:09 smithi066 bash[19869]: cluster 2024-09-17T11:02:08.773459+0000 mgr.x (mgr.14152) 64 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:10.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:09 smithi066 bash[19869]: cluster 2024-09-17T11:02:08.773459+0000 mgr.x (mgr.14152) 64 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:12.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:11 smithi066 bash[19869]: cluster 2024-09-17T11:02:10.773861+0000 mgr.x (mgr.14152) 65 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:12.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:11 smithi066 bash[19869]: cluster 2024-09-17T11:02:10.773861+0000 mgr.x (mgr.14152) 65 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:14.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:13 smithi066 bash[19869]: cluster 2024-09-17T11:02:12.774253+0000 mgr.x (mgr.14152) 66 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:14.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:13 smithi066 bash[19869]: cluster 2024-09-17T11:02:12.774253+0000 mgr.x (mgr.14152) 66 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:15.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:14 smithi066 bash[19869]: audit 2024-09-17T11:02:14.311491+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-17T11:02:15.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:14 smithi066 bash[19869]: audit 2024-09-17T11:02:14.311491+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-17T11:02:15.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:14 smithi066 bash[19869]: audit 2024-09-17T11:02:14.313161+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:02:15.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:14 smithi066 bash[19869]: audit 2024-09-17T11:02:14.313161+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:02:15.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:14 smithi066 bash[19869]: cephadm 2024-09-17T11:02:14.314619+0000 mgr.x (mgr.14152) 67 : cephadm [INF] Deploying daemon osd.0 on smithi066 2024-09-17T11:02:15.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:14 smithi066 bash[19869]: cephadm 2024-09-17T11:02:14.314619+0000 mgr.x (mgr.14152) 67 : cephadm [INF] Deploying daemon osd.0 on smithi066 2024-09-17T11:02:16.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:15 smithi066 bash[19869]: cluster 2024-09-17T11:02:14.774631+0000 mgr.x (mgr.14152) 68 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:16.206 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:15 smithi066 bash[19869]: cluster 2024-09-17T11:02:14.774631+0000 mgr.x (mgr.14152) 68 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:18.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:17 smithi066 bash[19869]: cluster 2024-09-17T11:02:16.775027+0000 mgr.x (mgr.14152) 69 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:18.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:17 smithi066 bash[19869]: cluster 2024-09-17T11:02:16.775027+0000 mgr.x (mgr.14152) 69 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:18 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:02:18.957 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:02:18 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:02:19.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:18 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:02:19.457 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:02:18 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:02:20.371 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:19 smithi066 bash[19869]: cluster 2024-09-17T11:02:18.775279+0000 mgr.x (mgr.14152) 70 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:20.371 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:19 smithi066 bash[19869]: cluster 2024-09-17T11:02:18.775279+0000 mgr.x (mgr.14152) 70 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:20.371 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:19 smithi066 bash[19869]: audit 2024-09-17T11:02:19.121261+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:02:20.371 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:19 smithi066 bash[19869]: audit 2024-09-17T11:02:19.121261+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:02:20.371 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:19 smithi066 bash[19869]: audit 2024-09-17T11:02:19.124732+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:20.371 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:19 smithi066 bash[19869]: audit 2024-09-17T11:02:19.124732+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:20.371 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:19 smithi066 bash[19869]: audit 2024-09-17T11:02:19.127916+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:20.372 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:19 smithi066 bash[19869]: audit 2024-09-17T11:02:19.127916+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:22.089 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:21 smithi066 bash[19869]: cluster 2024-09-17T11:02:20.775627+0000 mgr.x (mgr.14152) 71 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:22.089 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:21 smithi066 bash[19869]: cluster 2024-09-17T11:02:20.775627+0000 mgr.x (mgr.14152) 71 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:24.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:24 smithi066 bash[19869]: cluster 2024-09-17T11:02:22.776133+0000 mgr.x (mgr.14152) 72 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:24.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:24 smithi066 bash[19869]: cluster 2024-09-17T11:02:22.776133+0000 mgr.x (mgr.14152) 72 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:25.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:25 smithi066 bash[19869]: audit 2024-09-17T11:02:24.406943+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:25.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:25 smithi066 bash[19869]: audit 2024-09-17T11:02:24.406943+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:25.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:25 smithi066 bash[19869]: audit 2024-09-17T11:02:24.412000+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:25.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:25 smithi066 bash[19869]: audit 2024-09-17T11:02:24.412000+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:25.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:25 smithi066 bash[19869]: audit 2024-09-17T11:02:25.063972+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:02:25.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:25 smithi066 bash[19869]: audit 2024-09-17T11:02:25.063972+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:02:25.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:25 smithi066 bash[19869]: audit 2024-09-17T11:02:25.065072+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:02:25.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:25 smithi066 bash[19869]: audit 2024-09-17T11:02:25.065072+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:02:25.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:25 smithi066 bash[19869]: audit 2024-09-17T11:02:25.068706+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:25.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:25 smithi066 bash[19869]: audit 2024-09-17T11:02:25.068706+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:26.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:26 smithi066 bash[19869]: cluster 2024-09-17T11:02:24.776473+0000 mgr.x (mgr.14152) 73 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:26.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:26 smithi066 bash[19869]: cluster 2024-09-17T11:02:24.776473+0000 mgr.x (mgr.14152) 73 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:28.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:28 smithi066 bash[19869]: cluster 2024-09-17T11:02:26.776897+0000 mgr.x (mgr.14152) 74 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:28 smithi066 bash[19869]: cluster 2024-09-17T11:02:26.776897+0000 mgr.x (mgr.14152) 74 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:28.992 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 0 on host 'smithi066' 2024-09-17T11:02:29.558 DEBUG:teuthology.orchestra.run.smithi066:osd.0> sudo journalctl -f -n 0 -u ceph-b966aac8-74e3-11ef-bceb-c7b262605968@osd.0.service 2024-09-17T11:02:29.561 INFO:tasks.cephadm:Deploying osd.1 on smithi066 with /dev/vg_nvme/lv_3... 2024-09-17T11:02:29.561 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-17T11:02:29.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:29 smithi066 bash[19869]: audit 2024-09-17T11:02:28.976693+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:02:29.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:29 smithi066 bash[19869]: audit 2024-09-17T11:02:28.976693+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:02:29.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:29 smithi066 bash[19869]: audit 2024-09-17T11:02:28.981823+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:29.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:29 smithi066 bash[19869]: audit 2024-09-17T11:02:28.981823+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:29.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:29 smithi066 bash[19869]: audit 2024-09-17T11:02:28.987257+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:29.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:29 smithi066 bash[19869]: audit 2024-09-17T11:02:28.987257+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:29.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:29 smithi066 bash[19869]: audit 2024-09-17T11:02:29.334310+0000 mon.a (mon.0) 167 : audit [INF] from='osd.0 [v2:172.21.15.66:6802/3878939464,v1:172.21.15.66:6803/3878939464]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-17T11:02:29.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:29 smithi066 bash[19869]: audit 2024-09-17T11:02:29.334310+0000 mon.a (mon.0) 167 : audit [INF] from='osd.0 [v2:172.21.15.66:6802/3878939464,v1:172.21.15.66:6803/3878939464]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-17T11:02:30.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:30 smithi066 bash[19869]: cluster 2024-09-17T11:02:28.777307+0000 mgr.x (mgr.14152) 75 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:30.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:30 smithi066 bash[19869]: cluster 2024-09-17T11:02:28.777307+0000 mgr.x (mgr.14152) 75 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:30.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:30 smithi066 bash[19869]: audit 2024-09-17T11:02:29.985266+0000 mon.a (mon.0) 168 : audit [INF] from='osd.0 [v2:172.21.15.66:6802/3878939464,v1:172.21.15.66:6803/3878939464]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T11:02:30.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:30 smithi066 bash[19869]: audit 2024-09-17T11:02:29.985266+0000 mon.a (mon.0) 168 : audit [INF] from='osd.0 [v2:172.21.15.66:6802/3878939464,v1:172.21.15.66:6803/3878939464]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T11:02:30.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:30 smithi066 bash[19869]: cluster 2024-09-17T11:02:29.989932+0000 mon.a (mon.0) 169 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-17T11:02:30.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:30 smithi066 bash[19869]: cluster 2024-09-17T11:02:29.989932+0000 mon.a (mon.0) 169 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-17T11:02:30.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:30 smithi066 bash[19869]: audit 2024-09-17T11:02:29.990407+0000 mon.a (mon.0) 170 : audit [INF] from='osd.0 [v2:172.21.15.66:6802/3878939464,v1:172.21.15.66:6803/3878939464]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-17T11:02:30.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:30 smithi066 bash[19869]: audit 2024-09-17T11:02:29.990407+0000 mon.a (mon.0) 170 : audit [INF] from='osd.0 [v2:172.21.15.66:6802/3878939464,v1:172.21.15.66:6803/3878939464]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-17T11:02:30.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:30 smithi066 bash[19869]: audit 2024-09-17T11:02:29.990885+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T11:02:30.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:30 smithi066 bash[19869]: audit 2024-09-17T11:02:29.990885+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T11:02:31.957 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:02:31 smithi066 bash[29451]: debug 2024-09-17T11:02:31.506+0000 7f50bbb65640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T11:02:31.958 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:02:31 smithi066 bash[29451]: debug 2024-09-17T11:02:31.530+0000 7f50b3170640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T11:02:32.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:31 smithi066 bash[19869]: cluster 2024-09-17T11:02:30.777782+0000 mgr.x (mgr.14152) 76 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:32.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:31 smithi066 bash[19869]: cluster 2024-09-17T11:02:30.777782+0000 mgr.x (mgr.14152) 76 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:32.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:31 smithi066 bash[19869]: audit 2024-09-17T11:02:30.986309+0000 mon.a (mon.0) 172 : audit [INF] from='osd.0 [v2:172.21.15.66:6802/3878939464,v1:172.21.15.66:6803/3878939464]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-17T11:02:32.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:31 smithi066 bash[19869]: audit 2024-09-17T11:02:30.986309+0000 mon.a (mon.0) 172 : audit [INF] from='osd.0 [v2:172.21.15.66:6802/3878939464,v1:172.21.15.66:6803/3878939464]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-17T11:02:32.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:31 smithi066 bash[19869]: cluster 2024-09-17T11:02:30.994954+0000 mon.a (mon.0) 173 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-17T11:02:32.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:31 smithi066 bash[19869]: cluster 2024-09-17T11:02:30.994954+0000 mon.a (mon.0) 173 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-17T11:02:32.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:31 smithi066 bash[19869]: audit 2024-09-17T11:02:30.996049+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T11:02:32.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:31 smithi066 bash[19869]: audit 2024-09-17T11:02:30.996049+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T11:02:32.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:31 smithi066 bash[19869]: audit 2024-09-17T11:02:31.002166+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T11:02:32.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:31 smithi066 bash[19869]: audit 2024-09-17T11:02:31.002166+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T11:02:32.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:31 smithi066 bash[19869]: audit 2024-09-17T11:02:31.514357+0000 mon.a (mon.0) 176 : audit [INF] from='osd.0 [v2:172.21.15.66:6802/3878939464,v1:172.21.15.66:6803/3878939464]' entity='osd.0' 2024-09-17T11:02:32.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:31 smithi066 bash[19869]: audit 2024-09-17T11:02:31.514357+0000 mon.a (mon.0) 176 : audit [INF] from='osd.0 [v2:172.21.15.66:6802/3878939464,v1:172.21.15.66:6803/3878939464]' entity='osd.0' 2024-09-17T11:02:33.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:32 smithi066 bash[19869]: cluster 2024-09-17T11:02:30.358983+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T11:02:33.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:32 smithi066 bash[19869]: cluster 2024-09-17T11:02:30.358983+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T11:02:33.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:32 smithi066 bash[19869]: cluster 2024-09-17T11:02:30.359117+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T11:02:33.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:32 smithi066 bash[19869]: cluster 2024-09-17T11:02:30.359117+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T11:02:33.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:32 smithi066 bash[19869]: audit 2024-09-17T11:02:32.000470+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T11:02:33.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:32 smithi066 bash[19869]: audit 2024-09-17T11:02:32.000470+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T11:02:33.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:32 smithi066 bash[19869]: cluster 2024-09-17T11:02:32.520286+0000 mon.a (mon.0) 178 : cluster [INF] osd.0 [v2:172.21.15.66:6802/3878939464,v1:172.21.15.66:6803/3878939464] boot 2024-09-17T11:02:33.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:32 smithi066 bash[19869]: cluster 2024-09-17T11:02:32.520286+0000 mon.a (mon.0) 178 : cluster [INF] osd.0 [v2:172.21.15.66:6802/3878939464,v1:172.21.15.66:6803/3878939464] boot 2024-09-17T11:02:33.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:32 smithi066 bash[19869]: cluster 2024-09-17T11:02:32.520392+0000 mon.a (mon.0) 179 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-17T11:02:33.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:32 smithi066 bash[19869]: cluster 2024-09-17T11:02:32.520392+0000 mon.a (mon.0) 179 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-17T11:02:33.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:32 smithi066 bash[19869]: audit 2024-09-17T11:02:32.521091+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T11:02:33.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:32 smithi066 bash[19869]: audit 2024-09-17T11:02:32.521091+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T11:02:34.034 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:02:34.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:34 smithi066 bash[19869]: cluster 2024-09-17T11:02:32.778215+0000 mgr.x (mgr.14152) 77 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:34.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:34 smithi066 bash[19869]: cluster 2024-09-17T11:02:32.778215+0000 mgr.x (mgr.14152) 77 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T11:02:34.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:34 smithi066 bash[19869]: cluster 2024-09-17T11:02:34.000361+0000 mon.a (mon.0) 181 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-17T11:02:34.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:34 smithi066 bash[19869]: cluster 2024-09-17T11:02:34.000361+0000 mon.a (mon.0) 181 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-17T11:02:36.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:36 smithi066 bash[19869]: cluster 2024-09-17T11:02:34.778698+0000 mgr.x (mgr.14152) 78 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:36.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:36 smithi066 bash[19869]: cluster 2024-09-17T11:02:34.778698+0000 mgr.x (mgr.14152) 78 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:38.913 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:38 smithi066 bash[19869]: cluster 2024-09-17T11:02:36.779165+0000 mgr.x (mgr.14152) 79 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:38.914 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:38 smithi066 bash[19869]: cluster 2024-09-17T11:02:36.779165+0000 mgr.x (mgr.14152) 79 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:40.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: cluster 2024-09-17T11:02:38.779561+0000 mgr.x (mgr.14152) 80 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:40.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: cluster 2024-09-17T11:02:38.779561+0000 mgr.x (mgr.14152) 80 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:40.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: audit 2024-09-17T11:02:39.571307+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:40.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: audit 2024-09-17T11:02:39.571307+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:40.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: audit 2024-09-17T11:02:39.575725+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:40.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: audit 2024-09-17T11:02:39.575725+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:40.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: audit 2024-09-17T11:02:39.577392+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-17T11:02:40.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: audit 2024-09-17T11:02:39.577392+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-17T11:02:40.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: audit 2024-09-17T11:02:39.580507+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:40.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: audit 2024-09-17T11:02:39.580507+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:40.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: audit 2024-09-17T11:02:39.582640+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:02:40.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: audit 2024-09-17T11:02:39.582640+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:02:40.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: audit 2024-09-17T11:02:39.583567+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:02:40.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: audit 2024-09-17T11:02:39.583567+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:02:40.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: audit 2024-09-17T11:02:39.587684+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:40.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:40 smithi066 bash[19869]: audit 2024-09-17T11:02:39.587684+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:02:41.876 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:02:41.924 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:41 smithi066 bash[19869]: cephadm 2024-09-17T11:02:39.566533+0000 mgr.x (mgr.14152) 81 : cephadm [INF] Detected new or changed devices on smithi066 2024-09-17T11:02:41.925 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:41 smithi066 bash[19869]: cephadm 2024-09-17T11:02:39.566533+0000 mgr.x (mgr.14152) 81 : cephadm [INF] Detected new or changed devices on smithi066 2024-09-17T11:02:41.925 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:41 smithi066 bash[19869]: cephadm 2024-09-17T11:02:39.578305+0000 mgr.x (mgr.14152) 82 : cephadm [INF] Adjusting osd_memory_target on smithi066 to 17265M 2024-09-17T11:02:41.925 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:41 smithi066 bash[19869]: cephadm 2024-09-17T11:02:39.578305+0000 mgr.x (mgr.14152) 82 : cephadm [INF] Adjusting osd_memory_target on smithi066 to 17265M 2024-09-17T11:02:41.926 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_3 2024-09-17T11:02:42.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:42 smithi066 bash[19869]: cluster 2024-09-17T11:02:40.780007+0000 mgr.x (mgr.14152) 83 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:42.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:42 smithi066 bash[19869]: cluster 2024-09-17T11:02:40.780007+0000 mgr.x (mgr.14152) 83 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:44.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:44 smithi066 bash[19869]: cluster 2024-09-17T11:02:42.780463+0000 mgr.x (mgr.14152) 84 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:44.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:44 smithi066 bash[19869]: cluster 2024-09-17T11:02:42.780463+0000 mgr.x (mgr.14152) 84 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:46.712 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:02:46.809 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:46 smithi066 bash[19869]: cluster 2024-09-17T11:02:44.781055+0000 mgr.x (mgr.14152) 85 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:46.809 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:46 smithi066 bash[19869]: cluster 2024-09-17T11:02:44.781055+0000 mgr.x (mgr.14152) 85 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:48.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:48 smithi066 bash[19869]: cluster 2024-09-17T11:02:46.781632+0000 mgr.x (mgr.14152) 86 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:48.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:48 smithi066 bash[19869]: cluster 2024-09-17T11:02:46.781632+0000 mgr.x (mgr.14152) 86 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:48.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:48 smithi066 bash[19869]: audit 2024-09-17T11:02:48.091539+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-17T11:02:48.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:48 smithi066 bash[19869]: audit 2024-09-17T11:02:48.091539+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-17T11:02:48.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:48 smithi066 bash[19869]: audit 2024-09-17T11:02:48.096675+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-17T11:02:48.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:48 smithi066 bash[19869]: audit 2024-09-17T11:02:48.096675+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-17T11:02:48.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:48 smithi066 bash[19869]: audit 2024-09-17T11:02:48.097645+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:02:48.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:48 smithi066 bash[19869]: audit 2024-09-17T11:02:48.097645+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:02:49.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:49 smithi066 bash[19869]: audit 2024-09-17T11:02:48.087642+0000 mgr.x (mgr.14152) 87 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:02:49.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:49 smithi066 bash[19869]: audit 2024-09-17T11:02:48.087642+0000 mgr.x (mgr.14152) 87 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:02:50.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:50 smithi066 bash[19869]: cluster 2024-09-17T11:02:48.782194+0000 mgr.x (mgr.14152) 88 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:50.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:50 smithi066 bash[19869]: cluster 2024-09-17T11:02:48.782194+0000 mgr.x (mgr.14152) 88 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:51.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:51 smithi066 bash[19869]: cluster 2024-09-17T11:02:50.782775+0000 mgr.x (mgr.14152) 89 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:51.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:51 smithi066 bash[19869]: cluster 2024-09-17T11:02:50.782775+0000 mgr.x (mgr.14152) 89 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:54.110 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:53 smithi066 bash[19869]: cluster 2024-09-17T11:02:52.783274+0000 mgr.x (mgr.14152) 90 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:54.110 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:53 smithi066 bash[19869]: cluster 2024-09-17T11:02:52.783274+0000 mgr.x (mgr.14152) 90 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:56.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:55 smithi066 bash[19869]: cluster 2024-09-17T11:02:54.783694+0000 mgr.x (mgr.14152) 91 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:56.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:55 smithi066 bash[19869]: cluster 2024-09-17T11:02:54.783694+0000 mgr.x (mgr.14152) 91 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:57.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:56 smithi066 bash[19869]: audit 2024-09-17T11:02:56.495414+0000 mon.a (mon.0) 192 : audit [INF] from='client.? 172.21.15.66:0/1991506952' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8472fd13-8039-45e6-b4f5-8016939b6f98"} : dispatch 2024-09-17T11:02:57.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:56 smithi066 bash[19869]: audit 2024-09-17T11:02:56.495414+0000 mon.a (mon.0) 192 : audit [INF] from='client.? 172.21.15.66:0/1991506952' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8472fd13-8039-45e6-b4f5-8016939b6f98"} : dispatch 2024-09-17T11:02:57.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:56 smithi066 bash[19869]: audit 2024-09-17T11:02:56.496433+0000 mon.a (mon.0) 193 : audit [INF] from='client.? 172.21.15.66:0/1991506952' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8472fd13-8039-45e6-b4f5-8016939b6f98"}]': finished 2024-09-17T11:02:57.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:56 smithi066 bash[19869]: audit 2024-09-17T11:02:56.496433+0000 mon.a (mon.0) 193 : audit [INF] from='client.? 172.21.15.66:0/1991506952' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8472fd13-8039-45e6-b4f5-8016939b6f98"}]': finished 2024-09-17T11:02:57.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:56 smithi066 bash[19869]: cluster 2024-09-17T11:02:56.501843+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-17T11:02:57.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:56 smithi066 bash[19869]: cluster 2024-09-17T11:02:56.501843+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-17T11:02:57.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:56 smithi066 bash[19869]: audit 2024-09-17T11:02:56.502125+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T11:02:57.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:56 smithi066 bash[19869]: audit 2024-09-17T11:02:56.502125+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T11:02:58.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:57 smithi066 bash[19869]: cluster 2024-09-17T11:02:56.784166+0000 mgr.x (mgr.14152) 92 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:58.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:57 smithi066 bash[19869]: cluster 2024-09-17T11:02:56.784166+0000 mgr.x (mgr.14152) 92 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:02:58.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:57 smithi066 bash[19869]: audit 2024-09-17T11:02:57.149031+0000 mon.a (mon.0) 196 : audit [DBG] from='client.? 172.21.15.66:0/1589891469' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-17T11:02:58.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:57 smithi066 bash[19869]: audit 2024-09-17T11:02:57.149031+0000 mon.a (mon.0) 196 : audit [DBG] from='client.? 172.21.15.66:0/1589891469' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-17T11:03:00.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:59 smithi066 bash[19869]: cluster 2024-09-17T11:02:58.784675+0000 mgr.x (mgr.14152) 93 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:00.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:02:59 smithi066 bash[19869]: cluster 2024-09-17T11:02:58.784675+0000 mgr.x (mgr.14152) 93 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:02.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:01 smithi066 bash[19869]: cluster 2024-09-17T11:03:00.785154+0000 mgr.x (mgr.14152) 94 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:02.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:01 smithi066 bash[19869]: cluster 2024-09-17T11:03:00.785154+0000 mgr.x (mgr.14152) 94 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:04.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:03 smithi066 bash[19869]: cluster 2024-09-17T11:03:02.785737+0000 mgr.x (mgr.14152) 95 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:04.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:03 smithi066 bash[19869]: cluster 2024-09-17T11:03:02.785737+0000 mgr.x (mgr.14152) 95 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:06.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:05 smithi066 bash[19869]: cluster 2024-09-17T11:03:04.786227+0000 mgr.x (mgr.14152) 96 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:06.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:05 smithi066 bash[19869]: cluster 2024-09-17T11:03:04.786227+0000 mgr.x (mgr.14152) 96 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:08.100 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:07 smithi066 bash[19869]: cluster 2024-09-17T11:03:06.786657+0000 mgr.x (mgr.14152) 97 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:08.100 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:07 smithi066 bash[19869]: cluster 2024-09-17T11:03:06.786657+0000 mgr.x (mgr.14152) 97 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:10.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:09 smithi066 bash[19869]: cluster 2024-09-17T11:03:08.787128+0000 mgr.x (mgr.14152) 98 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:10.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:09 smithi066 bash[19869]: cluster 2024-09-17T11:03:08.787128+0000 mgr.x (mgr.14152) 98 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:11.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:10 smithi066 bash[19869]: audit 2024-09-17T11:03:09.978983+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-17T11:03:11.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:10 smithi066 bash[19869]: audit 2024-09-17T11:03:09.978983+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-17T11:03:11.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:10 smithi066 bash[19869]: audit 2024-09-17T11:03:09.980466+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:03:11.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:10 smithi066 bash[19869]: audit 2024-09-17T11:03:09.980466+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:03:11.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:10 smithi066 bash[19869]: cephadm 2024-09-17T11:03:09.981873+0000 mgr.x (mgr.14152) 99 : cephadm [INF] Deploying daemon osd.1 on smithi066 2024-09-17T11:03:11.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:10 smithi066 bash[19869]: cephadm 2024-09-17T11:03:09.981873+0000 mgr.x (mgr.14152) 99 : cephadm [INF] Deploying daemon osd.1 on smithi066 2024-09-17T11:03:12.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:11 smithi066 bash[19869]: cluster 2024-09-17T11:03:10.787511+0000 mgr.x (mgr.14152) 100 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:12.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:11 smithi066 bash[19869]: cluster 2024-09-17T11:03:10.787511+0000 mgr.x (mgr.14152) 100 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:14.180 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:13 smithi066 bash[19869]: cluster 2024-09-17T11:03:12.787933+0000 mgr.x (mgr.14152) 101 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:14.180 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:13 smithi066 bash[19869]: cluster 2024-09-17T11:03:12.787933+0000 mgr.x (mgr.14152) 101 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:14.431 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:03:14.431 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:03:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:03:14.431 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:03:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:03:14.707 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:03:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:03:14.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:03:14.708 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:03:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:03:15.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:14 smithi066 bash[19869]: audit 2024-09-17T11:03:14.692114+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:03:15.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:14 smithi066 bash[19869]: audit 2024-09-17T11:03:14.692114+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:03:15.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:14 smithi066 bash[19869]: audit 2024-09-17T11:03:14.695072+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:15.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:14 smithi066 bash[19869]: audit 2024-09-17T11:03:14.695072+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:15.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:14 smithi066 bash[19869]: audit 2024-09-17T11:03:14.698546+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:15.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:14 smithi066 bash[19869]: audit 2024-09-17T11:03:14.698546+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:16.118 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:15 smithi066 bash[19869]: cluster 2024-09-17T11:03:14.788287+0000 mgr.x (mgr.14152) 102 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:16.118 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:15 smithi066 bash[19869]: cluster 2024-09-17T11:03:14.788287+0000 mgr.x (mgr.14152) 102 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:18.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:17 smithi066 bash[19869]: cluster 2024-09-17T11:03:16.788588+0000 mgr.x (mgr.14152) 103 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:18.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:17 smithi066 bash[19869]: cluster 2024-09-17T11:03:16.788588+0000 mgr.x (mgr.14152) 103 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:20.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:19 smithi066 bash[19869]: cluster 2024-09-17T11:03:18.789031+0000 mgr.x (mgr.14152) 104 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:20.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:19 smithi066 bash[19869]: cluster 2024-09-17T11:03:18.789031+0000 mgr.x (mgr.14152) 104 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:22.140 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:21 smithi066 bash[19869]: cluster 2024-09-17T11:03:20.789488+0000 mgr.x (mgr.14152) 105 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:22.140 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:21 smithi066 bash[19869]: cluster 2024-09-17T11:03:20.789488+0000 mgr.x (mgr.14152) 105 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:23.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:23 smithi066 bash[19869]: audit 2024-09-17T11:03:22.311062+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:23.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:23 smithi066 bash[19869]: audit 2024-09-17T11:03:22.311062+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:23.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:23 smithi066 bash[19869]: audit 2024-09-17T11:03:22.313740+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:23.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:23 smithi066 bash[19869]: audit 2024-09-17T11:03:22.313740+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:23.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:23 smithi066 bash[19869]: audit 2024-09-17T11:03:22.320975+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:03:23.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:23 smithi066 bash[19869]: audit 2024-09-17T11:03:22.320975+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:03:23.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:23 smithi066 bash[19869]: audit 2024-09-17T11:03:22.321707+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:03:23.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:23 smithi066 bash[19869]: audit 2024-09-17T11:03:22.321707+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:03:23.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:23 smithi066 bash[19869]: audit 2024-09-17T11:03:22.324985+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:23.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:23 smithi066 bash[19869]: audit 2024-09-17T11:03:22.324985+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:24.635 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:24 smithi066 bash[19869]: cluster 2024-09-17T11:03:22.789965+0000 mgr.x (mgr.14152) 106 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:24.635 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:24 smithi066 bash[19869]: cluster 2024-09-17T11:03:22.789965+0000 mgr.x (mgr.14152) 106 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:24.635 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:24 smithi066 bash[19869]: audit 2024-09-17T11:03:24.015988+0000 mon.a (mon.0) 207 : audit [INF] from='osd.1 [v2:172.21.15.66:6810/2828063781,v1:172.21.15.66:6811/2828063781]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-17T11:03:24.636 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:24 smithi066 bash[19869]: audit 2024-09-17T11:03:24.015988+0000 mon.a (mon.0) 207 : audit [INF] from='osd.1 [v2:172.21.15.66:6810/2828063781,v1:172.21.15.66:6811/2828063781]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-17T11:03:25.691 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:25 smithi066 bash[19869]: audit 2024-09-17T11:03:24.325424+0000 mon.a (mon.0) 208 : audit [INF] from='osd.1 [v2:172.21.15.66:6810/2828063781,v1:172.21.15.66:6811/2828063781]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T11:03:25.691 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:25 smithi066 bash[19869]: audit 2024-09-17T11:03:24.325424+0000 mon.a (mon.0) 208 : audit [INF] from='osd.1 [v2:172.21.15.66:6810/2828063781,v1:172.21.15.66:6811/2828063781]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T11:03:25.691 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:25 smithi066 bash[19869]: cluster 2024-09-17T11:03:24.330200+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-17T11:03:25.691 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:25 smithi066 bash[19869]: cluster 2024-09-17T11:03:24.330200+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-17T11:03:25.691 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:25 smithi066 bash[19869]: audit 2024-09-17T11:03:24.335941+0000 mon.a (mon.0) 210 : audit [INF] from='osd.1 [v2:172.21.15.66:6810/2828063781,v1:172.21.15.66:6811/2828063781]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-17T11:03:25.692 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:25 smithi066 bash[19869]: audit 2024-09-17T11:03:24.335941+0000 mon.a (mon.0) 210 : audit [INF] from='osd.1 [v2:172.21.15.66:6810/2828063781,v1:172.21.15.66:6811/2828063781]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-17T11:03:25.692 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:25 smithi066 bash[19869]: audit 2024-09-17T11:03:24.342110+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T11:03:25.692 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:25 smithi066 bash[19869]: audit 2024-09-17T11:03:24.342110+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T11:03:26.405 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 1 on host 'smithi066' 2024-09-17T11:03:26.597 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:26 smithi066 bash[19869]: cluster 2024-09-17T11:03:24.790276+0000 mgr.x (mgr.14152) 107 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:26.598 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:26 smithi066 bash[19869]: cluster 2024-09-17T11:03:24.790276+0000 mgr.x (mgr.14152) 107 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:26.598 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:26 smithi066 bash[19869]: audit 2024-09-17T11:03:25.335147+0000 mon.a (mon.0) 212 : audit [INF] from='osd.1 [v2:172.21.15.66:6810/2828063781,v1:172.21.15.66:6811/2828063781]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-17T11:03:26.598 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:26 smithi066 bash[19869]: audit 2024-09-17T11:03:25.335147+0000 mon.a (mon.0) 212 : audit [INF] from='osd.1 [v2:172.21.15.66:6810/2828063781,v1:172.21.15.66:6811/2828063781]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-17T11:03:26.598 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:26 smithi066 bash[19869]: cluster 2024-09-17T11:03:25.339102+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-17T11:03:26.598 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:26 smithi066 bash[19869]: cluster 2024-09-17T11:03:25.339102+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-17T11:03:26.598 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:26 smithi066 bash[19869]: audit 2024-09-17T11:03:25.339635+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T11:03:26.598 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:26 smithi066 bash[19869]: audit 2024-09-17T11:03:25.339635+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T11:03:26.598 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:26 smithi066 bash[19869]: audit 2024-09-17T11:03:25.344351+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T11:03:26.598 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:26 smithi066 bash[19869]: audit 2024-09-17T11:03:25.344351+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T11:03:27.026 DEBUG:teuthology.orchestra.run.smithi066:osd.1> sudo journalctl -f -n 0 -u ceph-b966aac8-74e3-11ef-bceb-c7b262605968@osd.1.service 2024-09-17T11:03:27.029 INFO:tasks.cephadm:Waiting for 2 OSDs to come up... 2024-09-17T11:03:27.032 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T11:03:27.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: cluster 2024-09-17T11:03:24.982700+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T11:03:27.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: cluster 2024-09-17T11:03:24.982700+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-17T11:03:27.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: cluster 2024-09-17T11:03:24.982766+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T11:03:27.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: cluster 2024-09-17T11:03:24.982766+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-17T11:03:27.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: cluster 2024-09-17T11:03:26.343086+0000 mon.a (mon.0) 216 : cluster [INF] osd.1 [v2:172.21.15.66:6810/2828063781,v1:172.21.15.66:6811/2828063781] boot 2024-09-17T11:03:27.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: cluster 2024-09-17T11:03:26.343086+0000 mon.a (mon.0) 216 : cluster [INF] osd.1 [v2:172.21.15.66:6810/2828063781,v1:172.21.15.66:6811/2828063781] boot 2024-09-17T11:03:27.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: cluster 2024-09-17T11:03:26.343188+0000 mon.a (mon.0) 217 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-17T11:03:27.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: cluster 2024-09-17T11:03:26.343188+0000 mon.a (mon.0) 217 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-17T11:03:27.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: audit 2024-09-17T11:03:26.343896+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T11:03:27.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: audit 2024-09-17T11:03:26.343896+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T11:03:27.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: audit 2024-09-17T11:03:26.389813+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:03:27.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: audit 2024-09-17T11:03:26.389813+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:03:27.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: audit 2024-09-17T11:03:26.394312+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:27.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: audit 2024-09-17T11:03:26.394312+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:27.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: audit 2024-09-17T11:03:26.400468+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:27.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: audit 2024-09-17T11:03:26.400468+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:27.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: audit 2024-09-17T11:03:27.273144+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-17T11:03:27.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:27 smithi066 bash[19869]: audit 2024-09-17T11:03:27.273144+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-17T11:03:28.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:28 smithi066 bash[19869]: cluster 2024-09-17T11:03:26.790653+0000 mgr.x (mgr.14152) 108 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:28 smithi066 bash[19869]: cluster 2024-09-17T11:03:26.790653+0000 mgr.x (mgr.14152) 108 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T11:03:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:28 smithi066 bash[19869]: audit 2024-09-17T11:03:27.403960+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T11:03:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:28 smithi066 bash[19869]: audit 2024-09-17T11:03:27.403960+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T11:03:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:28 smithi066 bash[19869]: cluster 2024-09-17T11:03:27.409139+0000 mon.a (mon.0) 224 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-17T11:03:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:28 smithi066 bash[19869]: cluster 2024-09-17T11:03:27.409139+0000 mon.a (mon.0) 224 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-17T11:03:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:28 smithi066 bash[19869]: audit 2024-09-17T11:03:27.410631+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-17T11:03:28.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:28 smithi066 bash[19869]: audit 2024-09-17T11:03:27.410631+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-17T11:03:29.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:29 smithi066 bash[19869]: audit 2024-09-17T11:03:28.405164+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T11:03:29.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:29 smithi066 bash[19869]: audit 2024-09-17T11:03:28.405164+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T11:03:29.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:29 smithi066 bash[19869]: cluster 2024-09-17T11:03:28.410468+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-09-17T11:03:29.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:29 smithi066 bash[19869]: cluster 2024-09-17T11:03:28.410468+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-09-17T11:03:29.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:29 smithi066 bash[19869]: audit 2024-09-17T11:03:28.553664+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:29.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:29 smithi066 bash[19869]: audit 2024-09-17T11:03:28.553664+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:29.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:29 smithi066 bash[19869]: audit 2024-09-17T11:03:28.604641+0000 mon.a (mon.0) 229 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T11:03:29.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:29 smithi066 bash[19869]: audit 2024-09-17T11:03:28.604641+0000 mon.a (mon.0) 229 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T11:03:29.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:29 smithi066 bash[19869]: audit 2024-09-17T11:03:28.650342+0000 mon.a (mon.0) 230 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T11:03:29.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:29 smithi066 bash[19869]: audit 2024-09-17T11:03:28.650342+0000 mon.a (mon.0) 230 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T11:03:29.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:29 smithi066 bash[19869]: audit 2024-09-17T11:03:28.650653+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-17T11:03:29.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:29 smithi066 bash[19869]: audit 2024-09-17T11:03:28.650653+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-17T11:03:30.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:30 smithi066 bash[19869]: cluster 2024-09-17T11:03:28.791174+0000 mgr.x (mgr.14152) 109 : cluster [DBG] pgmap v93: 1 pgs: 1 unknown; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:30.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:30 smithi066 bash[19869]: cluster 2024-09-17T11:03:28.791174+0000 mgr.x (mgr.14152) 109 : cluster [DBG] pgmap v93: 1 pgs: 1 unknown; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:30.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:30 smithi066 bash[19869]: cluster 2024-09-17T11:03:29.419067+0000 mon.a (mon.0) 232 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-09-17T11:03:30.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:30 smithi066 bash[19869]: cluster 2024-09-17T11:03:29.419067+0000 mon.a (mon.0) 232 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-09-17T11:03:31.823 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:03:31.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:31 smithi066 bash[19869]: cluster 2024-09-17T11:03:30.563895+0000 mon.a (mon.0) 233 : cluster [DBG] mgrmap e15: x(active, since 2m) 2024-09-17T11:03:31.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:31 smithi066 bash[19869]: cluster 2024-09-17T11:03:30.563895+0000 mon.a (mon.0) 233 : cluster [DBG] mgrmap e15: x(active, since 2m) 2024-09-17T11:03:31.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:31 smithi066 bash[19869]: cluster 2024-09-17T11:03:30.791783+0000 mgr.x (mgr.14152) 110 : cluster [DBG] pgmap v95: 1 pgs: 1 unknown; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:31.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:31 smithi066 bash[19869]: cluster 2024-09-17T11:03:30.791783+0000 mgr.x (mgr.14152) 110 : cluster [DBG] pgmap v95: 1 pgs: 1 unknown; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:33.721 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:03:33.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:33 smithi066 bash[19869]: cluster 2024-09-17T11:03:32.792396+0000 mgr.x (mgr.14152) 111 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 58 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:33 smithi066 bash[19869]: cluster 2024-09-17T11:03:32.792396+0000 mgr.x (mgr.14152) 111 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 58 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:33 smithi066 bash[19869]: audit 2024-09-17T11:03:33.719894+0000 mon.a (mon.0) 234 : audit [DBG] from='client.? 172.21.15.66:0/828638930' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-17T11:03:33.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:33 smithi066 bash[19869]: audit 2024-09-17T11:03:33.719894+0000 mon.a (mon.0) 234 : audit [DBG] from='client.? 172.21.15.66:0/828638930' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-17T11:03:34.827 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":16,"num_osds":2,"num_up_osds":2,"osd_up_since":1726571006,"num_in_osds":2,"osd_in_since":1726570976,"num_remapped_pgs":0} 2024-09-17T11:03:34.828 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T11:03:36.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:35 smithi066 bash[19869]: cluster 2024-09-17T11:03:34.792957+0000 mgr.x (mgr.14152) 112 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:36.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:35 smithi066 bash[19869]: cluster 2024-09-17T11:03:34.792957+0000 mgr.x (mgr.14152) 112 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:38.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: cluster 2024-09-17T11:03:36.793492+0000 mgr.x (mgr.14152) 113 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:38.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: cluster 2024-09-17T11:03:36.793492+0000 mgr.x (mgr.14152) 113 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:38.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: cephadm 2024-09-17T11:03:37.172923+0000 mgr.x (mgr.14152) 114 : cephadm [INF] Detected new or changed devices on smithi066 2024-09-17T11:03:38.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: cephadm 2024-09-17T11:03:37.172923+0000 mgr.x (mgr.14152) 114 : cephadm [INF] Detected new or changed devices on smithi066 2024-09-17T11:03:38.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.178899+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:38.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.178899+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:38.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.187588+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:38.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.187588+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:38.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.189862+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-17T11:03:38.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.189862+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-17T11:03:38.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.191592+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-17T11:03:38.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.191592+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-17T11:03:38.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: cephadm 2024-09-17T11:03:37.192910+0000 mgr.x (mgr.14152) 115 : cephadm [INF] Adjusting osd_memory_target on smithi066 to 8632M 2024-09-17T11:03:38.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: cephadm 2024-09-17T11:03:37.192910+0000 mgr.x (mgr.14152) 115 : cephadm [INF] Adjusting osd_memory_target on smithi066 to 8632M 2024-09-17T11:03:38.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.199904+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:38.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.199904+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:38.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.204004+0000 mon.a (mon.0) 240 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:03:38.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.204004+0000 mon.a (mon.0) 240 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:03:38.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.205946+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:03:38.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.205946+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:03:38.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.216011+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:38.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:38 smithi066 bash[19869]: audit 2024-09-17T11:03:37.216011+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:03:39.631 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:03:40.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:40 smithi066 bash[19869]: cluster 2024-09-17T11:03:38.793995+0000 mgr.x (mgr.14152) 116 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:40.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:40 smithi066 bash[19869]: cluster 2024-09-17T11:03:38.793995+0000 mgr.x (mgr.14152) 116 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:41.099 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:03:41.099 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":16,"fsid":"b966aac8-74e3-11ef-bceb-c7b262605968","created":"2024-09-17T10:59:27.449325+0000","modified":"2024-09-17T11:03:29.412026+0000","last_up_change":"2024-09-17T11:03:26.335168+0000","last_in_change":"2024-09-17T11:02:56.495792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T11:03:27.276351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e8a9c97-d54a-4fa1-a32e-32ed59700e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":3878939464},{"type":"v1","addr":"172.21.15.66:6803","nonce":3878939464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":3878939464},{"type":"v1","addr":"172.21.15.66:6805","nonce":3878939464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3878939464},{"type":"v1","addr":"172.21.15.66:6809","nonce":3878939464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":3878939464},{"type":"v1","addr":"172.21.15.66:6807","nonce":3878939464}]},"public_addr":"172.21.15.66:6803/3878939464","cluster_addr":"172.21.15.66:6805/3878939464","heartbeat_back_addr":"172.21.15.66:6809/3878939464","heartbeat_front_addr":"172.21.15.66:6807/3878939464","state":["exists","up"]},{"osd":1,"uuid":"8472fd13-8039-45e6-b4f5-8016939b6f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2828063781},{"type":"v1","addr":"172.21.15.66:6811","nonce":2828063781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2828063781},{"type":"v1","addr":"172.21.15.66:6813","nonce":2828063781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2828063781},{"type":"v1","addr":"172.21.15.66:6817","nonce":2828063781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2828063781},{"type":"v1","addr":"172.21.15.66:6815","nonce":2828063781}]},"public_addr":"172.21.15.66:6811/2828063781","cluster_addr":"172.21.15.66:6813/2828063781","heartbeat_back_addr":"172.21.15.66:6817/2828063781","heartbeat_front_addr":"172.21.15.66:6815/2828063781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T11:02:30.359123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T11:03:24.982770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/3558958899":"2024-09-18T11:00:32.745910+0000","172.21.15.66:0/2193927986":"2024-09-18T11:00:32.745910+0000","172.21.15.66:6800/3000433692":"2024-09-18T11:00:32.745910+0000","172.21.15.66:0/359578904":"2024-09-18T11:00:32.745910+0000","172.21.15.66:6801/3651727059":"2024-09-18T10:59:55.242060+0000","172.21.15.66:6800/3651727059":"2024-09-18T10:59:55.242060+0000","172.21.15.66:0/1940037044":"2024-09-18T10:59:55.242060+0000","172.21.15.66:0/1149258108":"2024-09-18T10:59:55.242060+0000","172.21.15.66:6801/3000433692":"2024-09-18T11:00:32.745910+0000","172.21.15.66:0/1718179195":"2024-09-18T10:59:55.242060+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T11:03:41.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:41 smithi066 bash[19869]: audit 2024-09-17T11:03:41.097123+0000 mon.a (mon.0) 243 : audit [DBG] from='client.? 172.21.15.66:0/1599403780' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-17T11:03:41.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:41 smithi066 bash[19869]: audit 2024-09-17T11:03:41.097123+0000 mon.a (mon.0) 243 : audit [DBG] from='client.? 172.21.15.66:0/1599403780' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-17T11:03:41.730 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T11:03:27.276351+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T11:03:41.731 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-17T11:03:42.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:42 smithi066 bash[19869]: cluster 2024-09-17T11:03:40.794361+0000 mgr.x (mgr.14152) 117 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:42.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:42 smithi066 bash[19869]: cluster 2024-09-17T11:03:40.794361+0000 mgr.x (mgr.14152) 117 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:44.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:44 smithi066 bash[19869]: cluster 2024-09-17T11:03:42.794833+0000 mgr.x (mgr.14152) 118 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:44.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:44 smithi066 bash[19869]: cluster 2024-09-17T11:03:42.794833+0000 mgr.x (mgr.14152) 118 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:46.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:46 smithi066 bash[19869]: cluster 2024-09-17T11:03:44.795446+0000 mgr.x (mgr.14152) 119 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:46.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:46 smithi066 bash[19869]: cluster 2024-09-17T11:03:44.795446+0000 mgr.x (mgr.14152) 119 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:46.474 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:03:47.954 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 1 2024-09-17T11:03:48.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:48 smithi066 bash[19869]: cluster 2024-09-17T11:03:46.796100+0000 mgr.x (mgr.14152) 120 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:48.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:48 smithi066 bash[19869]: cluster 2024-09-17T11:03:46.796100+0000 mgr.x (mgr.14152) 120 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:48.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:48 smithi066 bash[19869]: audit 2024-09-17T11:03:47.952162+0000 mon.a (mon.0) 244 : audit [DBG] from='client.? 172.21.15.66:0/4155295631' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-17T11:03:48.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:48 smithi066 bash[19869]: audit 2024-09-17T11:03:47.952162+0000 mon.a (mon.0) 244 : audit [DBG] from='client.? 172.21.15.66:0/4155295631' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-17T11:03:48.664 INFO:tasks.cephadm:Setting up client nodes... 2024-09-17T11:03:48.665 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T11:03:50.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:50 smithi066 bash[19869]: cluster 2024-09-17T11:03:48.796500+0000 mgr.x (mgr.14152) 121 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:50.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:50 smithi066 bash[19869]: cluster 2024-09-17T11:03:48.796500+0000 mgr.x (mgr.14152) 121 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:52.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:52 smithi066 bash[19869]: cluster 2024-09-17T11:03:50.796967+0000 mgr.x (mgr.14152) 122 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:52.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:52 smithi066 bash[19869]: cluster 2024-09-17T11:03:50.796967+0000 mgr.x (mgr.14152) 122 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:53.413 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:03:54.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:54 smithi066 bash[19869]: cluster 2024-09-17T11:03:52.797474+0000 mgr.x (mgr.14152) 123 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:54.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:54 smithi066 bash[19869]: cluster 2024-09-17T11:03:52.797474+0000 mgr.x (mgr.14152) 123 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:54.839 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2024-09-17T11:03:54.839 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAaYulmF7beMRAAxrZz7GMSo44+oSHYH43XCA== 2024-09-17T11:03:55.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:55 smithi066 bash[19869]: audit 2024-09-17T11:03:54.836376+0000 mon.a (mon.0) 245 : audit [INF] from='client.? 172.21.15.66:0/191004072' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-17T11:03:55.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:55 smithi066 bash[19869]: audit 2024-09-17T11:03:54.836376+0000 mon.a (mon.0) 245 : audit [INF] from='client.? 172.21.15.66:0/191004072' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-17T11:03:55.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:55 smithi066 bash[19869]: audit 2024-09-17T11:03:54.838055+0000 mon.a (mon.0) 246 : audit [INF] from='client.? 172.21.15.66:0/191004072' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T11:03:55.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:55 smithi066 bash[19869]: audit 2024-09-17T11:03:54.838055+0000 mon.a (mon.0) 246 : audit [INF] from='client.? 172.21.15.66:0/191004072' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T11:03:55.486 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-17T11:03:55.487 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-17T11:03:55.487 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T11:03:55.510 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph config log 1 --format=json 2024-09-17T11:03:56.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:56 smithi066 bash[19869]: cluster 2024-09-17T11:03:54.798072+0000 mgr.x (mgr.14152) 124 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:56.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:56 smithi066 bash[19869]: cluster 2024-09-17T11:03:54.798072+0000 mgr.x (mgr.14152) 124 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:58.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:58 smithi066 bash[19869]: cluster 2024-09-17T11:03:56.798720+0000 mgr.x (mgr.14152) 125 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:03:58.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:03:58 smithi066 bash[19869]: cluster 2024-09-17T11:03:56.798720+0000 mgr.x (mgr.14152) 125 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:00.305 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:04:00.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:00 smithi066 bash[19869]: cluster 2024-09-17T11:03:58.799398+0000 mgr.x (mgr.14152) 126 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:00.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:00 smithi066 bash[19869]: cluster 2024-09-17T11:03:58.799398+0000 mgr.x (mgr.14152) 126 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:01.788 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:04:02.402 INFO:teuthology.orchestra.run.smithi066.stdout:[{"version":12,"timestamp":"2024-09-17T11:03:37.193610+0000","name":"","changes":[{"name":"osd/host:smithi066/osd_memory_target","previous_value":"18104125440","new_value":"9052062720"}]}] 2024-09-17T11:04:02.402 INFO:tasks.ceph_manager:config epoch is 12 2024-09-17T11:04:02.403 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T11:04:02.403 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-17T11:04:02.403 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-17T11:04:02.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:02 smithi066 bash[19869]: cluster 2024-09-17T11:04:00.800042+0000 mgr.x (mgr.14152) 127 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:02.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:02 smithi066 bash[19869]: cluster 2024-09-17T11:04:00.800042+0000 mgr.x (mgr.14152) 127 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:02.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:02 smithi066 bash[19869]: audit 2024-09-17T11:04:01.786742+0000 mon.a (mon.0) 247 : audit [DBG] from='client.? 172.21.15.66:0/895067724' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-17T11:04:02.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:02 smithi066 bash[19869]: audit 2024-09-17T11:04:01.786742+0000 mon.a (mon.0) 247 : audit [DBG] from='client.? 172.21.15.66:0/895067724' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-17T11:04:04.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:04 smithi066 bash[19869]: cluster 2024-09-17T11:04:02.800567+0000 mgr.x (mgr.14152) 128 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:04 smithi066 bash[19869]: cluster 2024-09-17T11:04:02.800567+0000 mgr.x (mgr.14152) 128 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:06.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:06 smithi066 bash[19869]: cluster 2024-09-17T11:04:04.801077+0000 mgr.x (mgr.14152) 129 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:06.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:06 smithi066 bash[19869]: cluster 2024-09-17T11:04:04.801077+0000 mgr.x (mgr.14152) 129 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:04:08.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:08 smithi066 bash[19869]: cluster 2024-09-17T11:04:06.801564+0000 mgr.x (mgr.14152) 130 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:08.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:08 smithi066 bash[19869]: cluster 2024-09-17T11:04:06.801564+0000 mgr.x (mgr.14152) 130 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:08.559 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:04:09.236 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":15,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":644608279},{"type":"v1","addr":"172.21.15.66:6801","nonce":644608279}]},"active_addr":"172.21.15.66:6801/644608279","active_change":"2024-09-17T11:00:32.746126+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.66:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":1410234339}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":1216870821}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":1114114861}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":2153228400}]}]} 2024-09-17T11:04:09.239 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-17T11:04:09.239 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-17T11:04:09.239 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T11:04:09.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:09 smithi066 bash[19869]: audit 2024-09-17T11:04:08.552300+0000 mon.a (mon.0) 248 : audit [DBG] from='client.? 172.21.15.66:0/4164314142' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-17T11:04:09.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:09 smithi066 bash[19869]: audit 2024-09-17T11:04:08.552300+0000 mon.a (mon.0) 248 : audit [DBG] from='client.? 172.21.15.66:0/4164314142' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-17T11:04:10.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:10 smithi066 bash[19869]: cluster 2024-09-17T11:04:08.802150+0000 mgr.x (mgr.14152) 131 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:10.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:10 smithi066 bash[19869]: cluster 2024-09-17T11:04:08.802150+0000 mgr.x (mgr.14152) 131 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:12.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:12 smithi066 bash[19869]: cluster 2024-09-17T11:04:10.802666+0000 mgr.x (mgr.14152) 132 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:12.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:12 smithi066 bash[19869]: cluster 2024-09-17T11:04:10.802666+0000 mgr.x (mgr.14152) 132 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:13.988 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:04:14.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:14 smithi066 bash[19869]: cluster 2024-09-17T11:04:12.803195+0000 mgr.x (mgr.14152) 133 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:14.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:14 smithi066 bash[19869]: cluster 2024-09-17T11:04:12.803195+0000 mgr.x (mgr.14152) 133 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:15.345 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:04:15.346 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":16,"fsid":"b966aac8-74e3-11ef-bceb-c7b262605968","created":"2024-09-17T10:59:27.449325+0000","modified":"2024-09-17T11:03:29.412026+0000","last_up_change":"2024-09-17T11:03:26.335168+0000","last_in_change":"2024-09-17T11:02:56.495792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T11:03:27.276351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e8a9c97-d54a-4fa1-a32e-32ed59700e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":3878939464},{"type":"v1","addr":"172.21.15.66:6803","nonce":3878939464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":3878939464},{"type":"v1","addr":"172.21.15.66:6805","nonce":3878939464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3878939464},{"type":"v1","addr":"172.21.15.66:6809","nonce":3878939464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":3878939464},{"type":"v1","addr":"172.21.15.66:6807","nonce":3878939464}]},"public_addr":"172.21.15.66:6803/3878939464","cluster_addr":"172.21.15.66:6805/3878939464","heartbeat_back_addr":"172.21.15.66:6809/3878939464","heartbeat_front_addr":"172.21.15.66:6807/3878939464","state":["exists","up"]},{"osd":1,"uuid":"8472fd13-8039-45e6-b4f5-8016939b6f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2828063781},{"type":"v1","addr":"172.21.15.66:6811","nonce":2828063781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2828063781},{"type":"v1","addr":"172.21.15.66:6813","nonce":2828063781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2828063781},{"type":"v1","addr":"172.21.15.66:6817","nonce":2828063781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2828063781},{"type":"v1","addr":"172.21.15.66:6815","nonce":2828063781}]},"public_addr":"172.21.15.66:6811/2828063781","cluster_addr":"172.21.15.66:6813/2828063781","heartbeat_back_addr":"172.21.15.66:6817/2828063781","heartbeat_front_addr":"172.21.15.66:6815/2828063781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T11:02:30.359123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T11:03:24.982770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/3558958899":"2024-09-18T11:00:32.745910+0000","172.21.15.66:0/2193927986":"2024-09-18T11:00:32.745910+0000","172.21.15.66:6800/3000433692":"2024-09-18T11:00:32.745910+0000","172.21.15.66:0/359578904":"2024-09-18T11:00:32.745910+0000","172.21.15.66:6801/3651727059":"2024-09-18T10:59:55.242060+0000","172.21.15.66:6800/3651727059":"2024-09-18T10:59:55.242060+0000","172.21.15.66:0/1940037044":"2024-09-18T10:59:55.242060+0000","172.21.15.66:0/1149258108":"2024-09-18T10:59:55.242060+0000","172.21.15.66:6801/3000433692":"2024-09-18T11:00:32.745910+0000","172.21.15.66:0/1718179195":"2024-09-18T10:59:55.242060+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T11:04:16.059 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-17T11:04:16.059 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T11:04:16.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:16 smithi066 bash[19869]: cluster 2024-09-17T11:04:14.803762+0000 mgr.x (mgr.14152) 134 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:16.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:16 smithi066 bash[19869]: cluster 2024-09-17T11:04:14.803762+0000 mgr.x (mgr.14152) 134 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:16.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:16 smithi066 bash[19869]: audit 2024-09-17T11:04:15.343571+0000 mon.a (mon.0) 249 : audit [DBG] from='client.? 172.21.15.66:0/1828920754' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-17T11:04:16.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:16 smithi066 bash[19869]: audit 2024-09-17T11:04:15.343571+0000 mon.a (mon.0) 249 : audit [DBG] from='client.? 172.21.15.66:0/1828920754' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-17T11:04:18.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:18 smithi066 bash[19869]: cluster 2024-09-17T11:04:16.804356+0000 mgr.x (mgr.14152) 135 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:18.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:18 smithi066 bash[19869]: cluster 2024-09-17T11:04:16.804356+0000 mgr.x (mgr.14152) 135 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:20.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:20 smithi066 bash[19869]: cluster 2024-09-17T11:04:18.804753+0000 mgr.x (mgr.14152) 136 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:20.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:20 smithi066 bash[19869]: cluster 2024-09-17T11:04:18.804753+0000 mgr.x (mgr.14152) 136 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:20.813 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:04:22.098 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:04:22.098 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":16,"fsid":"b966aac8-74e3-11ef-bceb-c7b262605968","created":"2024-09-17T10:59:27.449325+0000","modified":"2024-09-17T11:03:29.412026+0000","last_up_change":"2024-09-17T11:03:26.335168+0000","last_in_change":"2024-09-17T11:02:56.495792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T11:03:27.276351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8e8a9c97-d54a-4fa1-a32e-32ed59700e56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":3878939464},{"type":"v1","addr":"172.21.15.66:6803","nonce":3878939464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":3878939464},{"type":"v1","addr":"172.21.15.66:6805","nonce":3878939464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3878939464},{"type":"v1","addr":"172.21.15.66:6809","nonce":3878939464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":3878939464},{"type":"v1","addr":"172.21.15.66:6807","nonce":3878939464}]},"public_addr":"172.21.15.66:6803/3878939464","cluster_addr":"172.21.15.66:6805/3878939464","heartbeat_back_addr":"172.21.15.66:6809/3878939464","heartbeat_front_addr":"172.21.15.66:6807/3878939464","state":["exists","up"]},{"osd":1,"uuid":"8472fd13-8039-45e6-b4f5-8016939b6f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2828063781},{"type":"v1","addr":"172.21.15.66:6811","nonce":2828063781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2828063781},{"type":"v1","addr":"172.21.15.66:6813","nonce":2828063781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2828063781},{"type":"v1","addr":"172.21.15.66:6817","nonce":2828063781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2828063781},{"type":"v1","addr":"172.21.15.66:6815","nonce":2828063781}]},"public_addr":"172.21.15.66:6811/2828063781","cluster_addr":"172.21.15.66:6813/2828063781","heartbeat_back_addr":"172.21.15.66:6817/2828063781","heartbeat_front_addr":"172.21.15.66:6815/2828063781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T11:02:30.359123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T11:03:24.982770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/3558958899":"2024-09-18T11:00:32.745910+0000","172.21.15.66:0/2193927986":"2024-09-18T11:00:32.745910+0000","172.21.15.66:6800/3000433692":"2024-09-18T11:00:32.745910+0000","172.21.15.66:0/359578904":"2024-09-18T11:00:32.745910+0000","172.21.15.66:6801/3651727059":"2024-09-18T10:59:55.242060+0000","172.21.15.66:6800/3651727059":"2024-09-18T10:59:55.242060+0000","172.21.15.66:0/1940037044":"2024-09-18T10:59:55.242060+0000","172.21.15.66:0/1149258108":"2024-09-18T10:59:55.242060+0000","172.21.15.66:6801/3000433692":"2024-09-18T11:00:32.745910+0000","172.21.15.66:0/1718179195":"2024-09-18T10:59:55.242060+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T11:04:22.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:22 smithi066 bash[19869]: cluster 2024-09-17T11:04:20.805247+0000 mgr.x (mgr.14152) 137 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:22.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:22 smithi066 bash[19869]: cluster 2024-09-17T11:04:20.805247+0000 mgr.x (mgr.14152) 137 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:22.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:22 smithi066 bash[19869]: audit 2024-09-17T11:04:22.095443+0000 mon.a (mon.0) 250 : audit [DBG] from='client.? 172.21.15.66:0/2194856598' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-17T11:04:22.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:22 smithi066 bash[19869]: audit 2024-09-17T11:04:22.095443+0000 mon.a (mon.0) 250 : audit [DBG] from='client.? 172.21.15.66:0/2194856598' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-17T11:04:22.790 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-17T11:04:22.791 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-17T11:04:24.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:24 smithi066 bash[19869]: cluster 2024-09-17T11:04:22.805760+0000 mgr.x (mgr.14152) 138 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:24.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:24 smithi066 bash[19869]: cluster 2024-09-17T11:04:22.805760+0000 mgr.x (mgr.14152) 138 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:26.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:26 smithi066 bash[19869]: cluster 2024-09-17T11:04:24.806329+0000 mgr.x (mgr.14152) 139 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:26.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:26 smithi066 bash[19869]: cluster 2024-09-17T11:04:24.806329+0000 mgr.x (mgr.14152) 139 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:27.544 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:04:27.545 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:04:28.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:28 smithi066 bash[19869]: cluster 2024-09-17T11:04:26.806854+0000 mgr.x (mgr.14152) 140 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:28.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:28 smithi066 bash[19869]: cluster 2024-09-17T11:04:26.806854+0000 mgr.x (mgr.14152) 140 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:30.376 INFO:teuthology.orchestra.run.smithi066.stdout:34359738395 2024-09-17T11:04:30.381 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-17T11:04:30.382 INFO:teuthology.orchestra.run.smithi066.stdout:55834574864 2024-09-17T11:04:30.383 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-17T11:04:30.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:30 smithi066 bash[19869]: cluster 2024-09-17T11:04:28.807413+0000 mgr.x (mgr.14152) 141 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:30.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:30 smithi066 bash[19869]: cluster 2024-09-17T11:04:28.807413+0000 mgr.x (mgr.14152) 141 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:32.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:32 smithi066 bash[19869]: cluster 2024-09-17T11:04:30.807966+0000 mgr.x (mgr.14152) 142 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:32.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:32 smithi066 bash[19869]: cluster 2024-09-17T11:04:30.807966+0000 mgr.x (mgr.14152) 142 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:34.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:34 smithi066 bash[19869]: cluster 2024-09-17T11:04:32.808458+0000 mgr.x (mgr.14152) 143 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:34.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:34 smithi066 bash[19869]: cluster 2024-09-17T11:04:32.808458+0000 mgr.x (mgr.14152) 143 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:35.175 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:04:35.176 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:04:36.685 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:36 smithi066 bash[19869]: cluster 2024-09-17T11:04:34.808980+0000 mgr.x (mgr.14152) 144 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:36.685 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:36 smithi066 bash[19869]: cluster 2024-09-17T11:04:34.808980+0000 mgr.x (mgr.14152) 144 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:37.052 INFO:teuthology.orchestra.run.smithi066.stdout:55834574865 2024-09-17T11:04:37.062 INFO:teuthology.orchestra.run.smithi066.stdout:34359738396 2024-09-17T11:04:37.365 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:37 smithi066 bash[19869]: audit 2024-09-17T11:04:37.050790+0000 mon.a (mon.0) 251 : audit [DBG] from='client.? 172.21.15.66:0/3093190065' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-17T11:04:37.366 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:37 smithi066 bash[19869]: audit 2024-09-17T11:04:37.050790+0000 mon.a (mon.0) 251 : audit [DBG] from='client.? 172.21.15.66:0/3093190065' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-17T11:04:37.366 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:37 smithi066 bash[19869]: audit 2024-09-17T11:04:37.060937+0000 mon.a (mon.0) 252 : audit [DBG] from='client.? 172.21.15.66:0/3666937874' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-17T11:04:37.366 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:37 smithi066 bash[19869]: audit 2024-09-17T11:04:37.060937+0000 mon.a (mon.0) 252 : audit [DBG] from='client.? 172.21.15.66:0/3666937874' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-17T11:04:37.366 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:37 smithi066 bash[19869]: audit 2024-09-17T11:04:37.237433+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:04:37.366 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:37 smithi066 bash[19869]: audit 2024-09-17T11:04:37.237433+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:04:38.116 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574864 got 55834574865 for osd.1 2024-09-17T11:04:38.116 DEBUG:teuthology.parallel:result is None 2024-09-17T11:04:38.128 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738395 got 34359738396 for osd.0 2024-09-17T11:04:38.129 DEBUG:teuthology.parallel:result is None 2024-09-17T11:04:38.129 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-17T11:04:38.129 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T11:04:38.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:38 smithi066 bash[19869]: cluster 2024-09-17T11:04:36.809346+0000 mgr.x (mgr.14152) 145 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:38.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:38 smithi066 bash[19869]: cluster 2024-09-17T11:04:36.809346+0000 mgr.x (mgr.14152) 145 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:38.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:38 smithi066 bash[19869]: audit 2024-09-17T11:04:37.885473+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:04:38.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:38 smithi066 bash[19869]: audit 2024-09-17T11:04:37.885473+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:04:38.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:38 smithi066 bash[19869]: audit 2024-09-17T11:04:37.886777+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:04:38.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:38 smithi066 bash[19869]: audit 2024-09-17T11:04:37.886777+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:04:38.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:38 smithi066 bash[19869]: audit 2024-09-17T11:04:37.893280+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:04:38.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:38 smithi066 bash[19869]: audit 2024-09-17T11:04:37.893280+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:04:40.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:40 smithi066 bash[19869]: cluster 2024-09-17T11:04:38.809863+0000 mgr.x (mgr.14152) 146 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:40.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:40 smithi066 bash[19869]: cluster 2024-09-17T11:04:38.809863+0000 mgr.x (mgr.14152) 146 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:42.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:42 smithi066 bash[19869]: cluster 2024-09-17T11:04:40.810407+0000 mgr.x (mgr.14152) 147 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:42.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:42 smithi066 bash[19869]: cluster 2024-09-17T11:04:40.810407+0000 mgr.x (mgr.14152) 147 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:42.928 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:04:44.260 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:04:44.260 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-17T11:04:44.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:44 smithi066 bash[19869]: cluster 2024-09-17T11:04:42.810969+0000 mgr.x (mgr.14152) 148 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:44.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:44 smithi066 bash[19869]: cluster 2024-09-17T11:04:42.810969+0000 mgr.x (mgr.14152) 148 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:44.911 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-09-17T11:04:42.810730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":187490304,"kb_used":60144,"kb_used_data":1432,"kb_used_omap":3,"kb_used_meta":58172,"kb_avail":187430160,"statfs":{"total":191990071296,"available":191928483840,"internally_reserved":0,"allocated":1466368,"data_stored":1254480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3190,"internal_metadata":59569034},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003035"},"pg_stats":[{"pgid":"1.0","version":"15'52","reported_seq":80,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-17T11:03:29.416432+0000","last_change":"2024-09-17T11:03:28.416512+0000","last_active":"2024-09-17T11:03:29.416432+0000","last_peered":"2024-09-17T11:03:29.416432+0000","last_clean":"2024-09-17T11:03:29.416432+0000","last_became_active":"2024-09-17T11:03:28.415801+0000","last_became_peered":"2024-09-17T11:03:28.415801+0000","last_unstale":"2024-09-17T11:03:29.416432+0000","last_undegraded":"2024-09-17T11:03:29.416432+0000","last_fullsized":"2024-09-17T11:03:29.416432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T11:03:27.397815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T11:03:27.397815+0000","last_clean_scrub_stamp":"2024-09-17T11:03:27.397815+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:37.515147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":733184,"data_stored":627240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":733184,"data_stored":627240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T11:04:44.912 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T11:04:45.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:45 smithi066 bash[19869]: audit 2024-09-17T11:04:44.258165+0000 mgr.x (mgr.14152) 149 : audit [DBG] from='client.14235 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T11:04:45.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:45 smithi066 bash[19869]: audit 2024-09-17T11:04:44.258165+0000 mgr.x (mgr.14152) 149 : audit [DBG] from='client.14235 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T11:04:46.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:46 smithi066 bash[19869]: cluster 2024-09-17T11:04:44.811448+0000 mgr.x (mgr.14152) 150 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:46.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:46 smithi066 bash[19869]: cluster 2024-09-17T11:04:44.811448+0000 mgr.x (mgr.14152) 150 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:48.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:48 smithi066 bash[19869]: cluster 2024-09-17T11:04:46.811996+0000 mgr.x (mgr.14152) 151 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:48.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:48 smithi066 bash[19869]: cluster 2024-09-17T11:04:46.811996+0000 mgr.x (mgr.14152) 151 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:49.661 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:04:50.691 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:50 smithi066 bash[19869]: cluster 2024-09-17T11:04:48.812480+0000 mgr.x (mgr.14152) 152 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:50.692 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:50 smithi066 bash[19869]: cluster 2024-09-17T11:04:48.812480+0000 mgr.x (mgr.14152) 152 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:51.033 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:04:51.034 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-17T11:04:51.751 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-17T11:04:50.812699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":187490304,"kb_used":60144,"kb_used_data":1432,"kb_used_omap":3,"kb_used_meta":58172,"kb_avail":187430160,"statfs":{"total":191990071296,"available":191928483840,"internally_reserved":0,"allocated":1466368,"data_stored":1254480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3190,"internal_metadata":59569034},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003077"},"pg_stats":[{"pgid":"1.0","version":"15'52","reported_seq":80,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-17T11:03:29.416432+0000","last_change":"2024-09-17T11:03:28.416512+0000","last_active":"2024-09-17T11:03:29.416432+0000","last_peered":"2024-09-17T11:03:29.416432+0000","last_clean":"2024-09-17T11:03:29.416432+0000","last_became_active":"2024-09-17T11:03:28.415801+0000","last_became_peered":"2024-09-17T11:03:28.415801+0000","last_unstale":"2024-09-17T11:03:29.416432+0000","last_undegraded":"2024-09-17T11:03:29.416432+0000","last_fullsized":"2024-09-17T11:03:29.416432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T11:03:27.397815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T11:03:27.397815+0000","last_clean_scrub_stamp":"2024-09-17T11:03:27.397815+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:37.515147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":733184,"data_stored":627240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738399,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":733184,"data_stored":627240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T11:04:51.752 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-17T11:04:51.752 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T11:04:51.752 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-17T11:04:51.752 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-17T11:04:52.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:52 smithi066 bash[19869]: cluster 2024-09-17T11:04:50.812821+0000 mgr.x (mgr.14152) 153 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:52.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:52 smithi066 bash[19869]: cluster 2024-09-17T11:04:50.812821+0000 mgr.x (mgr.14152) 153 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:52.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:52 smithi066 bash[19869]: audit 2024-09-17T11:04:51.031689+0000 mgr.x (mgr.14152) 154 : audit [DBG] from='client.14237 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T11:04:52.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:52 smithi066 bash[19869]: audit 2024-09-17T11:04:51.031689+0000 mgr.x (mgr.14152) 154 : audit [DBG] from='client.14237 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T11:04:54.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:54 smithi066 bash[19869]: cluster 2024-09-17T11:04:52.813302+0000 mgr.x (mgr.14152) 155 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:54.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:54 smithi066 bash[19869]: cluster 2024-09-17T11:04:52.813302+0000 mgr.x (mgr.14152) 155 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:56.502 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:04:56.683 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:56 smithi066 bash[19869]: cluster 2024-09-17T11:04:54.813827+0000 mgr.x (mgr.14152) 156 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:56.683 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:56 smithi066 bash[19869]: cluster 2024-09-17T11:04:54.813827+0000 mgr.x (mgr.14152) 156 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:57.903 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:04:57.903 INFO:teuthology.orchestra.run.smithi066.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T11:04:58.565 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:58 smithi066 bash[19869]: cluster 2024-09-17T11:04:56.814370+0000 mgr.x (mgr.14152) 157 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:58.565 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:58 smithi066 bash[19869]: cluster 2024-09-17T11:04:56.814370+0000 mgr.x (mgr.14152) 157 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:04:58.565 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:58 smithi066 bash[19869]: audit 2024-09-17T11:04:57.901442+0000 mon.a (mon.0) 257 : audit [DBG] from='client.? 172.21.15.66:0/1178569052' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-17T11:04:58.566 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:04:58 smithi066 bash[19869]: audit 2024-09-17T11:04:57.901442+0000 mon.a (mon.0) 257 : audit [DBG] from='client.? 172.21.15.66:0/1178569052' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-17T11:04:58.566 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-17T11:04:58.567 INFO:tasks.cephadm:Setup complete, yielding 2024-09-17T11:04:58.567 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T11:04:58.578 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-17T11:04:58.578 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs' 2024-09-17T11:05:00.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:00 smithi066 bash[19869]: cluster 2024-09-17T11:04:58.814962+0000 mgr.x (mgr.14152) 158 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:00.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:00 smithi066 bash[19869]: cluster 2024-09-17T11:04:58.814962+0000 mgr.x (mgr.14152) 158 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:02.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:02 smithi066 bash[19869]: cluster 2024-09-17T11:05:00.815579+0000 mgr.x (mgr.14152) 159 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:02.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:02 smithi066 bash[19869]: cluster 2024-09-17T11:05:00.815579+0000 mgr.x (mgr.14152) 159 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:03.330 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:05:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:04 smithi066 bash[19869]: cluster 2024-09-17T11:05:02.816217+0000 mgr.x (mgr.14152) 160 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:04.794 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:04 smithi066 bash[19869]: cluster 2024-09-17T11:05:02.816217+0000 mgr.x (mgr.14152) 160 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:05.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:05 smithi066 bash[19869]: audit 2024-09-17T11:05:04.663002+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"} : dispatch 2024-09-17T11:05:05.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:05 smithi066 bash[19869]: audit 2024-09-17T11:05:04.663002+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"} : dispatch 2024-09-17T11:05:06.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:06 smithi066 bash[19869]: audit 2024-09-17T11:05:04.662156+0000 mgr.x (mgr.14152) 161 : audit [DBG] from='client.14241 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:05:06.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:06 smithi066 bash[19869]: audit 2024-09-17T11:05:04.662156+0000 mgr.x (mgr.14152) 161 : audit [DBG] from='client.14241 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:05:06.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:06 smithi066 bash[19869]: cluster 2024-09-17T11:05:04.816732+0000 mgr.x (mgr.14152) 162 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:06.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:06 smithi066 bash[19869]: cluster 2024-09-17T11:05:04.816732+0000 mgr.x (mgr.14152) 162 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:06.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:06 smithi066 bash[19869]: audit 2024-09-17T11:05:05.289135+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-17T11:05:06.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:06 smithi066 bash[19869]: audit 2024-09-17T11:05:05.289135+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-17T11:05:06.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:06 smithi066 bash[19869]: cluster 2024-09-17T11:05:05.293430+0000 mon.a (mon.0) 260 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-09-17T11:05:06.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:06 smithi066 bash[19869]: cluster 2024-09-17T11:05:05.293430+0000 mon.a (mon.0) 260 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-09-17T11:05:06.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:06 smithi066 bash[19869]: audit 2024-09-17T11:05:05.295481+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"} : dispatch 2024-09-17T11:05:06.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:06 smithi066 bash[19869]: audit 2024-09-17T11:05:05.295481+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"} : dispatch 2024-09-17T11:05:06.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:06 smithi066 bash[19869]: debug 2024-09-17T11:05:06.309+0000 7ff0bc830640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T11:05:07.196 INFO:teuthology.run_tasks:Running task cephadm.wait_for_service... 2024-09-17T11:05:07.206 INFO:tasks.cephadm:Waiting for ceph service mds.cephfs to start (timeout 300)... 2024-09-17T11:05:07.206 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph orch ls -f json 2024-09-17T11:05:07.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.291817+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-17T11:05:07.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.291817+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-17T11:05:07.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: cluster 2024-09-17T11:05:06.299009+0000 mon.a (mon.0) 263 : cluster [DBG] osdmap e18: 2 total, 2 up, 2 in 2024-09-17T11:05:07.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: cluster 2024-09-17T11:05:06.299009+0000 mon.a (mon.0) 263 : cluster [DBG] osdmap e18: 2 total, 2 up, 2 in 2024-09-17T11:05:07.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.310253+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"} : dispatch 2024-09-17T11:05:07.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.310253+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"} : dispatch 2024-09-17T11:05:07.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: cluster 2024-09-17T11:05:06.312070+0000 mon.a (mon.0) 265 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T11:05:07.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: cluster 2024-09-17T11:05:06.312070+0000 mon.a (mon.0) 265 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T11:05:07.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: cluster 2024-09-17T11:05:06.312197+0000 mon.a (mon.0) 266 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T11:05:07.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: cluster 2024-09-17T11:05:06.312197+0000 mon.a (mon.0) 266 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T11:05:07.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.315664+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-17T11:05:07.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.315664+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-17T11:05:07.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: cluster 2024-09-17T11:05:06.323585+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e19: 2 total, 2 up, 2 in 2024-09-17T11:05:07.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: cluster 2024-09-17T11:05:06.323585+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e19: 2 total, 2 up, 2 in 2024-09-17T11:05:07.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: cluster 2024-09-17T11:05:06.324017+0000 mon.a (mon.0) 269 : cluster [DBG] fsmap cephfs:0 2024-09-17T11:05:07.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: cluster 2024-09-17T11:05:06.324017+0000 mon.a (mon.0) 269 : cluster [DBG] fsmap cephfs:0 2024-09-17T11:05:07.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: cephadm 2024-09-17T11:05:06.329983+0000 mgr.x (mgr.14152) 163 : cephadm [INF] Saving service mds.cephfs spec with placement count:2 2024-09-17T11:05:07.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: cephadm 2024-09-17T11:05:06.329983+0000 mgr.x (mgr.14152) 163 : cephadm [INF] Saving service mds.cephfs spec with placement count:2 2024-09-17T11:05:07.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.338549+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:07.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.338549+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:07.459 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.340567+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:05:07.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.340567+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:05:07.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.344927+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:05:07.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.344927+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:05:07.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.346553+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:05:07.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.346553+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:05:07.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.354129+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:07.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.354129+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:07.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.358168+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.fjggnr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T11:05:07.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.358168+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.fjggnr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T11:05:07.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.359559+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.fjggnr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T11:05:07.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.359559+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.fjggnr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T11:05:07.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.363368+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:05:07.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: audit 2024-09-17T11:05:06.363368+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:05:07.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: cephadm 2024-09-17T11:05:06.364387+0000 mgr.x (mgr.14152) 164 : cephadm [INF] Deploying daemon mds.cephfs.smithi066.fjggnr on smithi066 2024-09-17T11:05:07.461 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:07 smithi066 bash[19869]: cephadm 2024-09-17T11:05:06.364387+0000 mgr.x (mgr.14152) 164 : cephadm [INF] Deploying daemon mds.cephfs.smithi066.fjggnr on smithi066 2024-09-17T11:05:08.509 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:08 smithi066 bash[19869]: cluster 2024-09-17T11:05:06.817267+0000 mgr.x (mgr.14152) 165 : cluster [DBG] pgmap v146: 65 pgs: 64 unknown, 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:08.509 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:08 smithi066 bash[19869]: cluster 2024-09-17T11:05:06.817267+0000 mgr.x (mgr.14152) 165 : cluster [DBG] pgmap v146: 65 pgs: 64 unknown, 1 active+clean; 577 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:08.509 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:08 smithi066 bash[19869]: cluster 2024-09-17T11:05:07.324609+0000 mon.a (mon.0) 278 : cluster [DBG] osdmap e20: 2 total, 2 up, 2 in 2024-09-17T11:05:08.509 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:08 smithi066 bash[19869]: cluster 2024-09-17T11:05:07.324609+0000 mon.a (mon.0) 278 : cluster [DBG] osdmap e20: 2 total, 2 up, 2 in 2024-09-17T11:05:09.328 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:09 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:09.328 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:09 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:09.329 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:05:09 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:09.329 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:05:09 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:09.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:09 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:09.708 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:05:09 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:09.708 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:05:09 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:09.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:09 smithi066 bash[19869]: cluster 2024-09-17T11:05:08.321709+0000 mon.a (mon.0) 279 : cluster [DBG] osdmap e21: 2 total, 2 up, 2 in 2024-09-17T11:05:09.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:09 smithi066 bash[19869]: cluster 2024-09-17T11:05:08.321709+0000 mon.a (mon.0) 279 : cluster [DBG] osdmap e21: 2 total, 2 up, 2 in 2024-09-17T11:05:09.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:09 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:10.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: cluster 2024-09-17T11:05:08.817868+0000 mgr.x (mgr.14152) 166 : cluster [DBG] pgmap v149: 65 pgs: 2 active, 8 creating+activating, 55 active+clean; 577 KiB data, 58 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:10.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: cluster 2024-09-17T11:05:08.817868+0000 mgr.x (mgr.14152) 166 : cluster [DBG] pgmap v149: 65 pgs: 2 active, 8 creating+activating, 55 active+clean; 577 KiB data, 58 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:10.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: audit 2024-09-17T11:05:09.491571+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:10.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: audit 2024-09-17T11:05:09.491571+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:10.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: audit 2024-09-17T11:05:09.494094+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:10.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: audit 2024-09-17T11:05:09.494094+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:10.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: audit 2024-09-17T11:05:09.496619+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:10.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: audit 2024-09-17T11:05:09.496619+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:10.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: audit 2024-09-17T11:05:09.497222+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.lwdicv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T11:05:10.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: audit 2024-09-17T11:05:09.497222+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.lwdicv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T11:05:10.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: audit 2024-09-17T11:05:09.498007+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.lwdicv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T11:05:10.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: audit 2024-09-17T11:05:09.498007+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.lwdicv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T11:05:10.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: audit 2024-09-17T11:05:09.499598+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:05:10.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: audit 2024-09-17T11:05:09.499598+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:05:10.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: cephadm 2024-09-17T11:05:09.500392+0000 mgr.x (mgr.14152) 167 : cephadm [INF] Deploying daemon mds.cephfs.smithi066.lwdicv on smithi066 2024-09-17T11:05:10.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:10 smithi066 bash[19869]: cephadm 2024-09-17T11:05:09.500392+0000 mgr.x (mgr.14152) 167 : cephadm [INF] Deploying daemon mds.cephfs.smithi066.lwdicv on smithi066 2024-09-17T11:05:12.544 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:12 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:12.545 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:05:12 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:12.545 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:05:12 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:12.545 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:12.545 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:10.818463+0000 mgr.x (mgr.14152) 168 : cluster [DBG] pgmap v150: 65 pgs: 2 active, 8 creating+activating, 55 active+clean; 577 KiB data, 58 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:12.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:10.818463+0000 mgr.x (mgr.14152) 168 : cluster [DBG] pgmap v150: 65 pgs: 2 active, 8 creating+activating, 55 active+clean; 577 KiB data, 58 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:12.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.495500+0000 mon.a (mon.0) 286 : cluster [DBG] mds.? [v2:172.21.15.66:6818/2401156853,v1:172.21.15.66:6819/2401156853] up:boot 2024-09-17T11:05:12.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.495500+0000 mon.a (mon.0) 286 : cluster [DBG] mds.? [v2:172.21.15.66:6818/2401156853,v1:172.21.15.66:6819/2401156853] up:boot 2024-09-17T11:05:12.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.495596+0000 mon.a (mon.0) 287 : cluster [INF] daemon mds.cephfs.smithi066.fjggnr assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-17T11:05:12.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.495596+0000 mon.a (mon.0) 287 : cluster [INF] daemon mds.cephfs.smithi066.fjggnr assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-17T11:05:12.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.495657+0000 mon.a (mon.0) 288 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T11:05:12.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.495657+0000 mon.a (mon.0) 288 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T11:05:12.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.495678+0000 mon.a (mon.0) 289 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T11:05:12.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.495678+0000 mon.a (mon.0) 289 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T11:05:12.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.495697+0000 mon.a (mon.0) 290 : cluster [INF] Cluster is now healthy 2024-09-17T11:05:12.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.495697+0000 mon.a (mon.0) 290 : cluster [INF] Cluster is now healthy 2024-09-17T11:05:12.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.495896+0000 mon.a (mon.0) 291 : cluster [DBG] fsmap cephfs:0 1 up:standby 2024-09-17T11:05:12.547 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.495896+0000 mon.a (mon.0) 291 : cluster [DBG] fsmap cephfs:0 1 up:standby 2024-09-17T11:05:12.547 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: audit 2024-09-17T11:05:11.496008+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "cephfs.smithi066.fjggnr"} : dispatch 2024-09-17T11:05:12.547 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: audit 2024-09-17T11:05:11.496008+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "cephfs.smithi066.fjggnr"} : dispatch 2024-09-17T11:05:12.547 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.497821+0000 mon.a (mon.0) 293 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi066.fjggnr=up:creating} 2024-09-17T11:05:12.547 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.497821+0000 mon.a (mon.0) 293 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi066.fjggnr=up:creating} 2024-09-17T11:05:12.547 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.512172+0000 mon.a (mon.0) 294 : cluster [INF] daemon mds.cephfs.smithi066.fjggnr is now active in filesystem cephfs as rank 0 2024-09-17T11:05:12.547 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 bash[19869]: cluster 2024-09-17T11:05:11.512172+0000 mon.a (mon.0) 294 : cluster [INF] daemon mds.cephfs.smithi066.fjggnr is now active in filesystem cephfs as rank 0 2024-09-17T11:05:12.869 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:12 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:12.870 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:12 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:12.870 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:05:12 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:12.870 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:05:12 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:05:12.968 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:05:13.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: cluster 2024-09-17T11:05:12.502564+0000 mon.a (mon.0) 295 : cluster [DBG] mds.? [v2:172.21.15.66:6818/2401156853,v1:172.21.15.66:6819/2401156853] up:active 2024-09-17T11:05:13.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: cluster 2024-09-17T11:05:12.502564+0000 mon.a (mon.0) 295 : cluster [DBG] mds.? [v2:172.21.15.66:6818/2401156853,v1:172.21.15.66:6819/2401156853] up:active 2024-09-17T11:05:13.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: cluster 2024-09-17T11:05:12.502649+0000 mon.a (mon.0) 296 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi066.fjggnr=up:active} 2024-09-17T11:05:13.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: cluster 2024-09-17T11:05:12.502649+0000 mon.a (mon.0) 296 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi066.fjggnr=up:active} 2024-09-17T11:05:13.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: audit 2024-09-17T11:05:12.807978+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:13.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: audit 2024-09-17T11:05:12.807978+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:13.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: audit 2024-09-17T11:05:12.810490+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:13.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: audit 2024-09-17T11:05:12.810490+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:13.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: audit 2024-09-17T11:05:12.815826+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:13.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: audit 2024-09-17T11:05:12.815826+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:13.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: audit 2024-09-17T11:05:12.821116+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:13.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: audit 2024-09-17T11:05:12.821116+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:13.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: audit 2024-09-17T11:05:12.824374+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:13.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: audit 2024-09-17T11:05:12.824374+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:13.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: audit 2024-09-17T11:05:12.832954+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:05:13.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: audit 2024-09-17T11:05:12.832954+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:05:13.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: audit 2024-09-17T11:05:13.221944+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:13.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:13 smithi066 bash[19869]: audit 2024-09-17T11:05:13.221944+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:14.778 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:14 smithi066 bash[19869]: cluster 2024-09-17T11:05:12.818915+0000 mgr.x (mgr.14152) 169 : cluster [DBG] pgmap v151: 65 pgs: 65 active+clean; 577 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 315 B/s wr, 1 op/s 2024-09-17T11:05:14.778 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:14 smithi066 bash[19869]: cluster 2024-09-17T11:05:12.818915+0000 mgr.x (mgr.14152) 169 : cluster [DBG] pgmap v151: 65 pgs: 65 active+clean; 577 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 315 B/s wr, 1 op/s 2024-09-17T11:05:14.999 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:05:14.999 INFO:teuthology.orchestra.run.smithi066.stdout:[{"events": ["2024-09-17T11:05:12.824588Z service:mds.cephfs [INFO] \"service was created\""], "placement": {"count": 2}, "service_id": "cephfs", "service_name": "mds.cephfs", "service_type": "mds", "status": {"created": "2024-09-17T11:05:06.330020Z", "running": 0, "size": 2}}, {"events": ["2024-09-17T11:01:36.827632Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi066=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2024-09-17T11:01:36.809564Z", "last_refresh": "2024-09-17T11:03:22.307389Z", "running": 1, "size": 1}}, {"events": ["2024-09-17T11:01:16.228853Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi066:172.21.15.66=a"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2024-09-17T11:01:16.208618Z", "last_refresh": "2024-09-17T11:03:22.307263Z", "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "6c1fcab85602ba9d6ddde3c89adee6ee0382b7527a8ed3ee372c969068775c76", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d1ee255599fffe6c832aeedeed0b06c298863896564017e014e180f38b9ae1bb", "last_refresh": "2024-09-17T11:03:22.307498Z", "running": 2, "size": 2}, "unmanaged": true}] 2024-09-17T11:05:15.629 INFO:tasks.cephadm:mds.cephfs has 0/2 2024-09-17T11:05:16.630 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph orch ls -f json 2024-09-17T11:05:16.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:14.819291+0000 mgr.x (mgr.14152) 170 : cluster [DBG] pgmap v152: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-17T11:05:16.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:14.819291+0000 mgr.x (mgr.14152) 170 : cluster [DBG] pgmap v152: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-17T11:05:16.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: audit 2024-09-17T11:05:14.996157+0000 mgr.x (mgr.14152) 171 : audit [DBG] from='client.14247 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T11:05:16.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: audit 2024-09-17T11:05:14.996157+0000 mgr.x (mgr.14152) 171 : audit [DBG] from='client.14247 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T11:05:16.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.511865+0000 mon.a (mon.0) 304 : cluster [DBG] mds.? [v2:172.21.15.66:6820/1205117988,v1:172.21.15.66:6821/1205117988] up:boot 2024-09-17T11:05:16.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.511865+0000 mon.a (mon.0) 304 : cluster [DBG] mds.? [v2:172.21.15.66:6820/1205117988,v1:172.21.15.66:6821/1205117988] up:boot 2024-09-17T11:05:16.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.512035+0000 mon.a (mon.0) 305 : cluster [INF] Dropping low affinity active daemon mds.cephfs.smithi066.fjggnr in favor of higher affinity standby. 2024-09-17T11:05:16.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.512035+0000 mon.a (mon.0) 305 : cluster [INF] Dropping low affinity active daemon mds.cephfs.smithi066.fjggnr in favor of higher affinity standby. 2024-09-17T11:05:16.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.512124+0000 mon.a (mon.0) 306 : cluster [WRN] Replacing daemon mds.cephfs.smithi066.fjggnr as rank 0 with standby daemon mds.cephfs.smithi066.lwdicv 2024-09-17T11:05:16.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.512124+0000 mon.a (mon.0) 306 : cluster [WRN] Replacing daemon mds.cephfs.smithi066.fjggnr as rank 0 with standby daemon mds.cephfs.smithi066.lwdicv 2024-09-17T11:05:16.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.512615+0000 mon.a (mon.0) 307 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T11:05:16.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.512615+0000 mon.a (mon.0) 307 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T11:05:16.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.512652+0000 mon.a (mon.0) 308 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T11:05:16.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.512652+0000 mon.a (mon.0) 308 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T11:05:16.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.513066+0000 mon.a (mon.0) 309 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi066.fjggnr=up:active} 1 up:standby 2024-09-17T11:05:16.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.513066+0000 mon.a (mon.0) 309 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi066.fjggnr=up:active} 1 up:standby 2024-09-17T11:05:16.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: audit 2024-09-17T11:05:15.513237+0000 mon.a (mon.0) 310 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "cephfs.smithi066.lwdicv"} : dispatch 2024-09-17T11:05:16.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: audit 2024-09-17T11:05:15.513237+0000 mon.a (mon.0) 310 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "cephfs.smithi066.lwdicv"} : dispatch 2024-09-17T11:05:16.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.518436+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e22: 2 total, 2 up, 2 in 2024-09-17T11:05:16.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.518436+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e22: 2 total, 2 up, 2 in 2024-09-17T11:05:16.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.518785+0000 mon.a (mon.0) 312 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi066.lwdicv=up:replay} 2024-09-17T11:05:16.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:16 smithi066 bash[19869]: cluster 2024-09-17T11:05:15.518785+0000 mon.a (mon.0) 312 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi066.lwdicv=up:replay} 2024-09-17T11:05:17.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: cluster 2024-09-17T11:05:16.514374+0000 mon.a (mon.0) 313 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T11:05:17.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: cluster 2024-09-17T11:05:16.514374+0000 mon.a (mon.0) 313 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T11:05:17.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: cluster 2024-09-17T11:05:16.526127+0000 mon.a (mon.0) 314 : cluster [DBG] mds.? [v2:172.21.15.66:6820/1205117988,v1:172.21.15.66:6821/1205117988] up:reconnect 2024-09-17T11:05:17.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: cluster 2024-09-17T11:05:16.526127+0000 mon.a (mon.0) 314 : cluster [DBG] mds.? [v2:172.21.15.66:6820/1205117988,v1:172.21.15.66:6821/1205117988] up:reconnect 2024-09-17T11:05:17.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: cluster 2024-09-17T11:05:16.526184+0000 mon.a (mon.0) 315 : cluster [DBG] mds.? [v2:172.21.15.66:6818/4170283972,v1:172.21.15.66:6819/4170283972] up:boot 2024-09-17T11:05:17.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: cluster 2024-09-17T11:05:16.526184+0000 mon.a (mon.0) 315 : cluster [DBG] mds.? [v2:172.21.15.66:6818/4170283972,v1:172.21.15.66:6819/4170283972] up:boot 2024-09-17T11:05:17.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: cluster 2024-09-17T11:05:16.526333+0000 mon.a (mon.0) 316 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi066.lwdicv=up:reconnect} 1 up:standby 2024-09-17T11:05:17.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: cluster 2024-09-17T11:05:16.526333+0000 mon.a (mon.0) 316 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi066.lwdicv=up:reconnect} 1 up:standby 2024-09-17T11:05:17.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: audit 2024-09-17T11:05:16.526996+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "cephfs.smithi066.fjggnr"} : dispatch 2024-09-17T11:05:17.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: audit 2024-09-17T11:05:16.526996+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "cephfs.smithi066.fjggnr"} : dispatch 2024-09-17T11:05:17.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: audit 2024-09-17T11:05:17.332444+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:17.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: audit 2024-09-17T11:05:17.332444+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:17.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: audit 2024-09-17T11:05:17.335110+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:17.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: audit 2024-09-17T11:05:17.335110+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:17.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: audit 2024-09-17T11:05:17.335847+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:05:17.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: audit 2024-09-17T11:05:17.335847+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:05:17.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: audit 2024-09-17T11:05:17.336562+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:05:17.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: audit 2024-09-17T11:05:17.336562+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:05:17.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: audit 2024-09-17T11:05:17.339670+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:17.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: audit 2024-09-17T11:05:17.339670+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:17.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: audit 2024-09-17T11:05:17.349981+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:05:17.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:17 smithi066 bash[19869]: audit 2024-09-17T11:05:17.349981+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:05:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:18 smithi066 bash[19869]: cluster 2024-09-17T11:05:16.819804+0000 mgr.x (mgr.14152) 172 : cluster [DBG] pgmap v154: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-17T11:05:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:18 smithi066 bash[19869]: cluster 2024-09-17T11:05:16.819804+0000 mgr.x (mgr.14152) 172 : cluster [DBG] pgmap v154: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-17T11:05:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:18 smithi066 bash[19869]: cluster 2024-09-17T11:05:17.534368+0000 mon.a (mon.0) 324 : cluster [DBG] mds.? [v2:172.21.15.66:6820/1205117988,v1:172.21.15.66:6821/1205117988] up:rejoin 2024-09-17T11:05:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:18 smithi066 bash[19869]: cluster 2024-09-17T11:05:17.534368+0000 mon.a (mon.0) 324 : cluster [DBG] mds.? [v2:172.21.15.66:6820/1205117988,v1:172.21.15.66:6821/1205117988] up:rejoin 2024-09-17T11:05:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:18 smithi066 bash[19869]: cluster 2024-09-17T11:05:17.534533+0000 mon.a (mon.0) 325 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi066.lwdicv=up:rejoin} 1 up:standby 2024-09-17T11:05:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:18 smithi066 bash[19869]: cluster 2024-09-17T11:05:17.534533+0000 mon.a (mon.0) 325 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi066.lwdicv=up:rejoin} 1 up:standby 2024-09-17T11:05:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:18 smithi066 bash[19869]: cluster 2024-09-17T11:05:17.534733+0000 mon.a (mon.0) 326 : cluster [INF] daemon mds.cephfs.smithi066.lwdicv is now active in filesystem cephfs as rank 0 2024-09-17T11:05:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:18 smithi066 bash[19869]: cluster 2024-09-17T11:05:17.534733+0000 mon.a (mon.0) 326 : cluster [INF] daemon mds.cephfs.smithi066.lwdicv is now active in filesystem cephfs as rank 0 2024-09-17T11:05:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:18 smithi066 bash[19869]: audit 2024-09-17T11:05:18.229862+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:18 smithi066 bash[19869]: audit 2024-09-17T11:05:18.229862+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:19.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:19 smithi066 bash[19869]: cluster 2024-09-17T11:05:18.530022+0000 mon.a (mon.0) 328 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T11:05:19.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:19 smithi066 bash[19869]: cluster 2024-09-17T11:05:18.530022+0000 mon.a (mon.0) 328 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T11:05:19.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:19 smithi066 bash[19869]: cluster 2024-09-17T11:05:18.530078+0000 mon.a (mon.0) 329 : cluster [INF] Cluster is now healthy 2024-09-17T11:05:19.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:19 smithi066 bash[19869]: cluster 2024-09-17T11:05:18.530078+0000 mon.a (mon.0) 329 : cluster [INF] Cluster is now healthy 2024-09-17T11:05:19.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:19 smithi066 bash[19869]: cluster 2024-09-17T11:05:18.541271+0000 mon.a (mon.0) 330 : cluster [DBG] mds.? [v2:172.21.15.66:6820/1205117988,v1:172.21.15.66:6821/1205117988] up:active 2024-09-17T11:05:19.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:19 smithi066 bash[19869]: cluster 2024-09-17T11:05:18.541271+0000 mon.a (mon.0) 330 : cluster [DBG] mds.? [v2:172.21.15.66:6820/1205117988,v1:172.21.15.66:6821/1205117988] up:active 2024-09-17T11:05:19.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:19 smithi066 bash[19869]: cluster 2024-09-17T11:05:18.541378+0000 mon.a (mon.0) 331 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi066.lwdicv=up:active} 1 up:standby 2024-09-17T11:05:19.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:19 smithi066 bash[19869]: cluster 2024-09-17T11:05:18.541378+0000 mon.a (mon.0) 331 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi066.lwdicv=up:active} 1 up:standby 2024-09-17T11:05:20.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:20 smithi066 bash[19869]: cluster 2024-09-17T11:05:18.820679+0000 mgr.x (mgr.14152) 173 : cluster [DBG] pgmap v155: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-17T11:05:20.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:20 smithi066 bash[19869]: cluster 2024-09-17T11:05:18.820679+0000 mgr.x (mgr.14152) 173 : cluster [DBG] pgmap v155: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-17T11:05:21.084 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:05:22.522 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:05:22.522 INFO:teuthology.orchestra.run.smithi066.stdout:[{"events": ["2024-09-17T11:05:12.824588Z service:mds.cephfs [INFO] \"service was created\""], "placement": {"count": 2}, "service_id": "cephfs", "service_name": "mds.cephfs", "service_type": "mds", "status": {"created": "2024-09-17T11:05:06.330020Z", "last_refresh": "2024-09-17T11:05:22.410178Z", "running": 2, "size": 2}}, {"events": ["2024-09-17T11:01:36.827632Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi066=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2024-09-17T11:01:36.809564Z", "last_refresh": "2024-09-17T11:05:22.409862Z", "running": 1, "size": 1}}, {"events": ["2024-09-17T11:01:16.228853Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi066:172.21.15.66=a"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2024-09-17T11:01:16.208618Z", "last_refresh": "2024-09-17T11:05:22.409737Z", "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "6c1fcab85602ba9d6ddde3c89adee6ee0382b7527a8ed3ee372c969068775c76", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d1ee255599fffe6c832aeedeed0b06c298863896564017e014e180f38b9ae1bb", "last_refresh": "2024-09-17T11:05:22.409970Z", "running": 2, "size": 2}, "unmanaged": true}] 2024-09-17T11:05:22.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:22 smithi066 bash[19869]: cluster 2024-09-17T11:05:20.821298+0000 mgr.x (mgr.14152) 174 : cluster [DBG] pgmap v156: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-17T11:05:22.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:22 smithi066 bash[19869]: cluster 2024-09-17T11:05:20.821298+0000 mgr.x (mgr.14152) 174 : cluster [DBG] pgmap v156: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-17T11:05:22.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:22 smithi066 bash[19869]: audit 2024-09-17T11:05:22.413586+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:22.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:22 smithi066 bash[19869]: audit 2024-09-17T11:05:22.413586+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:22.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:22 smithi066 bash[19869]: audit 2024-09-17T11:05:22.417210+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:22.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:22 smithi066 bash[19869]: audit 2024-09-17T11:05:22.417210+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:22.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:22 smithi066 bash[19869]: audit 2024-09-17T11:05:22.417916+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:05:22.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:22 smithi066 bash[19869]: audit 2024-09-17T11:05:22.417916+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:05:22.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:22 smithi066 bash[19869]: audit 2024-09-17T11:05:22.418655+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:05:22.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:22 smithi066 bash[19869]: audit 2024-09-17T11:05:22.418655+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:05:22.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:22 smithi066 bash[19869]: audit 2024-09-17T11:05:22.421786+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:22.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:22 smithi066 bash[19869]: audit 2024-09-17T11:05:22.421786+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14152 172.21.15.66:0/2381393203' entity='mgr.x' 2024-09-17T11:05:23.151 INFO:tasks.cephadm:mds.cephfs has 2/2 2024-09-17T11:05:23.151 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T11:05:23.162 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-17T11:05:23.162 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- bash -c 'ceph fs subvolumegroup create cephfs smb' 2024-09-17T11:05:23.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:23 smithi066 bash[19869]: audit 2024-09-17T11:05:22.515954+0000 mgr.x (mgr.14152) 175 : audit [DBG] from='client.14251 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T11:05:23.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:23 smithi066 bash[19869]: audit 2024-09-17T11:05:22.515954+0000 mgr.x (mgr.14152) 175 : audit [DBG] from='client.14251 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T11:05:24.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:24 smithi066 bash[19869]: cluster 2024-09-17T11:05:22.822082+0000 mgr.x (mgr.14152) 176 : cluster [DBG] pgmap v157: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-17T11:05:24.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:24 smithi066 bash[19869]: cluster 2024-09-17T11:05:22.822082+0000 mgr.x (mgr.14152) 176 : cluster [DBG] pgmap v157: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-17T11:05:26.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:26 smithi066 bash[19869]: cluster 2024-09-17T11:05:24.822754+0000 mgr.x (mgr.14152) 177 : cluster [DBG] pgmap v158: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-17T11:05:26.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:26 smithi066 bash[19869]: cluster 2024-09-17T11:05:24.822754+0000 mgr.x (mgr.14152) 177 : cluster [DBG] pgmap v158: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-17T11:05:27.934 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:05:28.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:28 smithi066 bash[19869]: cluster 2024-09-17T11:05:26.823382+0000 mgr.x (mgr.14152) 178 : cluster [DBG] pgmap v159: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-17T11:05:28.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:28 smithi066 bash[19869]: cluster 2024-09-17T11:05:26.823382+0000 mgr.x (mgr.14152) 178 : cluster [DBG] pgmap v159: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-17T11:05:29.707 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:29 smithi066 bash[20129]: debug 2024-09-17T11:05:29.396+0000 7fe45cb8a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:05:29.708 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:29 smithi066 bash[20129]: debug 2024-09-17T11:05:29.396+0000 7fe45cb8a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:05:29.708 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:29 smithi066 bash[20129]: debug 2024-09-17T11:05:29.396+0000 7fe45cb8a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:05:29.708 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:29 smithi066 bash[20129]: debug 2024-09-17T11:05:29.396+0000 7fe45cb8a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:05:29.708 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:29 smithi066 bash[20129]: debug 2024-09-17T11:05:29.396+0000 7fe45cb8a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:05:30.034 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- bash -c 'ceph fs subvolume create cephfs sv1 --group-name=smb --mode=0777' 2024-09-17T11:05:30.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:30 smithi066 bash[19869]: cluster 2024-09-17T11:05:28.824309+0000 mgr.x (mgr.14152) 179 : cluster [DBG] pgmap v160: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-17T11:05:30.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:30 smithi066 bash[19869]: cluster 2024-09-17T11:05:28.824309+0000 mgr.x (mgr.14152) 179 : cluster [DBG] pgmap v160: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-17T11:05:30.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:30 smithi066 bash[19869]: audit 2024-09-17T11:05:29.395485+0000 mgr.x (mgr.14152) 180 : audit [DBG] from='client.14253 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "smb", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:05:30.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:30 smithi066 bash[19869]: audit 2024-09-17T11:05:29.395485+0000 mgr.x (mgr.14152) 180 : audit [DBG] from='client.14253 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "smb", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:05:30.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:30 smithi066 bash[19869]: cluster 2024-09-17T11:05:29.572369+0000 mon.a (mon.0) 337 : cluster [DBG] mgrmap e16: x(active, since 4m) 2024-09-17T11:05:30.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:30 smithi066 bash[19869]: cluster 2024-09-17T11:05:29.572369+0000 mon.a (mon.0) 337 : cluster [DBG] mgrmap e16: x(active, since 4m) 2024-09-17T11:05:32.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:32 smithi066 bash[19869]: cluster 2024-09-17T11:05:30.824919+0000 mgr.x (mgr.14152) 181 : cluster [DBG] pgmap v161: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-17T11:05:32.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:32 smithi066 bash[19869]: cluster 2024-09-17T11:05:30.824919+0000 mgr.x (mgr.14152) 181 : cluster [DBG] pgmap v161: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-17T11:05:34.795 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:05:34.926 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:34 smithi066 bash[19869]: cluster 2024-09-17T11:05:32.825470+0000 mgr.x (mgr.14152) 182 : cluster [DBG] pgmap v162: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 5.8 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-17T11:05:34.926 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:34 smithi066 bash[19869]: cluster 2024-09-17T11:05:32.825470+0000 mgr.x (mgr.14152) 182 : cluster [DBG] pgmap v162: 65 pgs: 65 active+clean; 579 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 5.8 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-17T11:05:35.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:35 smithi066 bash[19869]: cluster 2024-09-17T11:05:34.826039+0000 mgr.x (mgr.14152) 183 : cluster [DBG] pgmap v163: 65 pgs: 65 active+clean; 585 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 4.3 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-17T11:05:35.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:35 smithi066 bash[19869]: cluster 2024-09-17T11:05:34.826039+0000 mgr.x (mgr.14152) 183 : cluster [DBG] pgmap v163: 65 pgs: 65 active+clean; 585 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 4.3 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-17T11:05:36.780 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- bash -c 'ceph fs subvolume create cephfs sv2 --group-name=smb --mode=0777' 2024-09-17T11:05:36.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:36 smithi066 bash[19869]: audit 2024-09-17T11:05:36.167922+0000 mgr.x (mgr.14152) 184 : audit [DBG] from='client.14257 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "smb", "mode": "0777", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:05:36.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:36 smithi066 bash[19869]: audit 2024-09-17T11:05:36.167922+0000 mgr.x (mgr.14152) 184 : audit [DBG] from='client.14257 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "smb", "mode": "0777", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:05:37.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:37 smithi066 bash[19869]: cluster 2024-09-17T11:05:36.826592+0000 mgr.x (mgr.14152) 185 : cluster [DBG] pgmap v164: 65 pgs: 65 active+clean; 585 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 853 B/s wr, 0 op/s 2024-09-17T11:05:37.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:37 smithi066 bash[19869]: cluster 2024-09-17T11:05:36.826592+0000 mgr.x (mgr.14152) 185 : cluster [DBG] pgmap v164: 65 pgs: 65 active+clean; 585 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 853 B/s wr, 0 op/s 2024-09-17T11:05:40.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:39 smithi066 bash[19869]: cluster 2024-09-17T11:05:38.827457+0000 mgr.x (mgr.14152) 186 : cluster [DBG] pgmap v165: 65 pgs: 65 active+clean; 600 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 2.3 KiB/s wr, 1 op/s 2024-09-17T11:05:40.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:39 smithi066 bash[19869]: cluster 2024-09-17T11:05:38.827457+0000 mgr.x (mgr.14152) 186 : cluster [DBG] pgmap v165: 65 pgs: 65 active+clean; 600 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 2.3 KiB/s wr, 1 op/s 2024-09-17T11:05:41.549 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:05:41.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:41 smithi066 bash[19869]: cluster 2024-09-17T11:05:40.828069+0000 mgr.x (mgr.14152) 187 : cluster [DBG] pgmap v166: 65 pgs: 65 active+clean; 600 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 2.3 KiB/s wr, 1 op/s 2024-09-17T11:05:41.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:41 smithi066 bash[19869]: cluster 2024-09-17T11:05:40.828069+0000 mgr.x (mgr.14152) 187 : cluster [DBG] pgmap v166: 65 pgs: 65 active+clean; 600 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 2.3 KiB/s wr, 1 op/s 2024-09-17T11:05:43.722 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- bash -c 'ceph mgr module enable smb' 2024-09-17T11:05:44.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:43 smithi066 bash[19869]: cluster 2024-09-17T11:05:42.828514+0000 mgr.x (mgr.14152) 188 : cluster [DBG] pgmap v167: 65 pgs: 65 active+clean; 600 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 2.4 KiB/s wr, 1 op/s 2024-09-17T11:05:44.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:43 smithi066 bash[19869]: cluster 2024-09-17T11:05:42.828514+0000 mgr.x (mgr.14152) 188 : cluster [DBG] pgmap v167: 65 pgs: 65 active+clean; 600 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 2.4 KiB/s wr, 1 op/s 2024-09-17T11:05:44.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:43 smithi066 bash[19869]: audit 2024-09-17T11:05:43.056436+0000 mgr.x (mgr.14152) 189 : audit [DBG] from='client.14259 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv2", "group_name": "smb", "mode": "0777", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:05:44.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:43 smithi066 bash[19869]: audit 2024-09-17T11:05:43.056436+0000 mgr.x (mgr.14152) 189 : audit [DBG] from='client.14259 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv2", "group_name": "smb", "mode": "0777", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:05:46.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:45 smithi066 bash[19869]: cluster 2024-09-17T11:05:44.829217+0000 mgr.x (mgr.14152) 190 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 605 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 2.7 KiB/s wr, 1 op/s 2024-09-17T11:05:46.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:45 smithi066 bash[19869]: cluster 2024-09-17T11:05:44.829217+0000 mgr.x (mgr.14152) 190 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 605 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 2.7 KiB/s wr, 1 op/s 2024-09-17T11:05:48.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:47 smithi066 bash[19869]: cluster 2024-09-17T11:05:46.829799+0000 mgr.x (mgr.14152) 191 : cluster [DBG] pgmap v169: 65 pgs: 65 active+clean; 605 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 2.0 KiB/s wr, 1 op/s 2024-09-17T11:05:48.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:47 smithi066 bash[19869]: cluster 2024-09-17T11:05:46.829799+0000 mgr.x (mgr.14152) 191 : cluster [DBG] pgmap v169: 65 pgs: 65 active+clean; 605 KiB data, 58 MiB used, 179 GiB / 179 GiB avail; 2.0 KiB/s wr, 1 op/s 2024-09-17T11:05:48.497 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:05:50.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:49 smithi066 bash[19869]: cluster 2024-09-17T11:05:48.830681+0000 mgr.x (mgr.14152) 192 : cluster [DBG] pgmap v170: 65 pgs: 65 active+clean; 631 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 4.7 KiB/s wr, 2 op/s 2024-09-17T11:05:50.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:49 smithi066 bash[19869]: cluster 2024-09-17T11:05:48.830681+0000 mgr.x (mgr.14152) 192 : cluster [DBG] pgmap v170: 65 pgs: 65 active+clean; 631 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 4.7 KiB/s wr, 2 op/s 2024-09-17T11:05:51.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:50 smithi066 bash[19869]: audit 2024-09-17T11:05:50.002336+0000 mon.a (mon.0) 338 : audit [INF] from='client.? 172.21.15.66:0/807991010' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "smb"} : dispatch 2024-09-17T11:05:51.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:50 smithi066 bash[19869]: audit 2024-09-17T11:05:50.002336+0000 mon.a (mon.0) 338 : audit [INF] from='client.? 172.21.15.66:0/807991010' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "smb"} : dispatch 2024-09-17T11:05:51.208 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:50 smithi066 bash[20129]: ignoring --setuser ceph since I am not root 2024-09-17T11:05:51.208 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:50 smithi066 bash[20129]: ignoring --setgroup ceph since I am not root 2024-09-17T11:05:51.593 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- bash -c 'sleep 30' 2024-09-17T11:05:52.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:51 smithi066 bash[19869]: audit 2024-09-17T11:05:50.900514+0000 mon.a (mon.0) 339 : audit [INF] from='client.? 172.21.15.66:0/807991010' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "smb"}]': finished 2024-09-17T11:05:52.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:51 smithi066 bash[19869]: audit 2024-09-17T11:05:50.900514+0000 mon.a (mon.0) 339 : audit [INF] from='client.? 172.21.15.66:0/807991010' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "smb"}]': finished 2024-09-17T11:05:52.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:51 smithi066 bash[19869]: cluster 2024-09-17T11:05:50.908194+0000 mon.a (mon.0) 340 : cluster [DBG] mgrmap e17: x(active, since 5m) 2024-09-17T11:05:52.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:51 smithi066 bash[19869]: cluster 2024-09-17T11:05:50.908194+0000 mon.a (mon.0) 340 : cluster [DBG] mgrmap e17: x(active, since 5m) 2024-09-17T11:05:56.351 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:05:57.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: cluster 2024-09-17T11:05:57.209512+0000 mon.a (mon.0) 341 : cluster [INF] Active manager daemon x restarted 2024-09-17T11:05:57.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: cluster 2024-09-17T11:05:57.209512+0000 mon.a (mon.0) 341 : cluster [INF] Active manager daemon x restarted 2024-09-17T11:05:57.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: cluster 2024-09-17T11:05:57.210082+0000 mon.a (mon.0) 342 : cluster [INF] Activating manager daemon x 2024-09-17T11:05:57.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: cluster 2024-09-17T11:05:57.210082+0000 mon.a (mon.0) 342 : cluster [INF] Activating manager daemon x 2024-09-17T11:05:57.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: cluster 2024-09-17T11:05:57.222652+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e23: 2 total, 2 up, 2 in 2024-09-17T11:05:57.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: cluster 2024-09-17T11:05:57.222652+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e23: 2 total, 2 up, 2 in 2024-09-17T11:05:57.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: cluster 2024-09-17T11:05:57.223887+0000 mon.a (mon.0) 344 : cluster [DBG] mgrmap e18: x(active, starting, since 0.0140003s) 2024-09-17T11:05:57.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: cluster 2024-09-17T11:05:57.223887+0000 mon.a (mon.0) 344 : cluster [DBG] mgrmap e18: x(active, starting, since 0.0140003s) 2024-09-17T11:05:57.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.231791+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-17T11:05:57.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.231791+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-17T11:05:57.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.232003+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "cephfs.smithi066.lwdicv"} : dispatch 2024-09-17T11:05:57.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.232003+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "cephfs.smithi066.lwdicv"} : dispatch 2024-09-17T11:05:57.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.232229+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "cephfs.smithi066.fjggnr"} : dispatch 2024-09-17T11:05:57.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.232229+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "cephfs.smithi066.fjggnr"} : dispatch 2024-09-17T11:05:57.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.242989+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-17T11:05:57.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.242989+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-17T11:05:57.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.243430+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T11:05:57.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.243430+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T11:05:57.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.243678+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T11:05:57.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.243678+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T11:05:57.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.246843+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-17T11:05:57.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.246843+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-17T11:05:57.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.247435+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-17T11:05:57.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.247435+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-17T11:05:57.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.247777+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-17T11:05:57.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:57 smithi066 bash[19869]: audit 2024-09-17T11:05:57.247777+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-17T11:05:58.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:58 smithi066 bash[19869]: cluster 2024-09-17T11:05:57.278924+0000 mon.a (mon.0) 354 : cluster [INF] Manager daemon x is now available 2024-09-17T11:05:58.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:58 smithi066 bash[19869]: cluster 2024-09-17T11:05:57.278924+0000 mon.a (mon.0) 354 : cluster [INF] Manager daemon x is now available 2024-09-17T11:05:58.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:58 smithi066 bash[19869]: audit 2024-09-17T11:05:57.727695+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:05:58.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:58 smithi066 bash[19869]: audit 2024-09-17T11:05:57.727695+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:05:58.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:58 smithi066 bash[19869]: audit 2024-09-17T11:05:57.749094+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-17T11:05:58.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:58 smithi066 bash[19869]: audit 2024-09-17T11:05:57.749094+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-17T11:05:58.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:58 smithi066 bash[19869]: audit 2024-09-17T11:05:57.751775+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "osd pool create", "pool": ".smb", "yes_i_really_mean_it": true} : dispatch 2024-09-17T11:05:58.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:58 smithi066 bash[19869]: audit 2024-09-17T11:05:57.751775+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "osd pool create", "pool": ".smb", "yes_i_really_mean_it": true} : dispatch 2024-09-17T11:05:58.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:58 smithi066 bash[19869]: audit 2024-09-17T11:05:57.757254+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-17T11:05:58.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:58 smithi066 bash[19869]: audit 2024-09-17T11:05:57.757254+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-17T11:05:59.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[19869]: audit 2024-09-17T11:05:58.269882+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd='[{"prefix": "osd pool create", "pool": ".smb", "yes_i_really_mean_it": true}]': finished 2024-09-17T11:05:59.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[19869]: audit 2024-09-17T11:05:58.269882+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd='[{"prefix": "osd pool create", "pool": ".smb", "yes_i_really_mean_it": true}]': finished 2024-09-17T11:05:59.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[19869]: cluster 2024-09-17T11:05:58.275778+0000 mon.a (mon.0) 360 : cluster [DBG] mgrmap e19: x(active, since 1.0659s) 2024-09-17T11:05:59.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[19869]: cluster 2024-09-17T11:05:58.275778+0000 mon.a (mon.0) 360 : cluster [DBG] mgrmap e19: x(active, since 1.0659s) 2024-09-17T11:05:59.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[19869]: cluster 2024-09-17T11:05:58.275919+0000 mon.a (mon.0) 361 : cluster [DBG] osdmap e24: 2 total, 2 up, 2 in 2024-09-17T11:05:59.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[19869]: cluster 2024-09-17T11:05:58.275919+0000 mon.a (mon.0) 361 : cluster [DBG] osdmap e24: 2 total, 2 up, 2 in 2024-09-17T11:05:59.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[19869]: audit 2024-09-17T11:05:58.290093+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "osd pool application enable", "pool": ".smb", "app": "smb"} : dispatch 2024-09-17T11:05:59.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[19869]: audit 2024-09-17T11:05:58.290093+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "osd pool application enable", "pool": ".smb", "app": "smb"} : dispatch 2024-09-17T11:05:59.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[19869]: cluster 2024-09-17T11:05:58.291665+0000 mgr.x (mgr.14263) 1 : cluster [DBG] pgmap v4: 97 pgs: 32 creating+peering, 65 active+clean; 640 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:59.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[19869]: cluster 2024-09-17T11:05:58.291665+0000 mgr.x (mgr.14263) 1 : cluster [DBG] pgmap v4: 97 pgs: 32 creating+peering, 65 active+clean; 640 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:05:59.709 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[20129]: debug 2024-09-17T11:05:59.316+0000 7f41aa3d3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:05:59.709 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[20129]: debug 2024-09-17T11:05:59.316+0000 7f41aa3d3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:05:59.709 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[20129]: debug 2024-09-17T11:05:59.316+0000 7f41aa3d3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:05:59.709 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[20129]: debug 2024-09-17T11:05:59.316+0000 7f41aa3d3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:05:59.709 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[20129]: debug 2024-09-17T11:05:59.316+0000 7f41aa3d3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:05:59.709 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[20129]: debug 2024-09-17T11:05:59.316+0000 7f41ad3d9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:05:59.709 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[20129]: debug 2024-09-17T11:05:59.316+0000 7f41ad3d9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:05:59.709 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[20129]: debug 2024-09-17T11:05:59.316+0000 7f41ad3d9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:05:59.709 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[20129]: debug 2024-09-17T11:05:59.316+0000 7f41ad3d9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:05:59.710 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:05:59 smithi066 bash[20129]: debug 2024-09-17T11:05:59.316+0000 7f41ad3d9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:06:00.640 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[19869]: cluster 2024-09-17T11:05:59.247118+0000 mgr.x (mgr.14263) 2 : cluster [DBG] pgmap v5: 97 pgs: 32 creating+peering, 65 active+clean; 640 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:00.640 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[19869]: cluster 2024-09-17T11:05:59.247118+0000 mgr.x (mgr.14263) 2 : cluster [DBG] pgmap v5: 97 pgs: 32 creating+peering, 65 active+clean; 640 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:00.640 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[19869]: cluster 2024-09-17T11:05:59.269958+0000 mon.a (mon.0) 363 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T11:06:00.640 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[19869]: cluster 2024-09-17T11:05:59.269958+0000 mon.a (mon.0) 363 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T11:06:00.640 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[19869]: audit 2024-09-17T11:05:59.276187+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "pool": ".smb", "app": "smb"}]': finished 2024-09-17T11:06:00.640 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[19869]: audit 2024-09-17T11:05:59.276187+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "pool": ".smb", "app": "smb"}]': finished 2024-09-17T11:06:00.641 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[19869]: cluster 2024-09-17T11:05:59.288088+0000 mon.a (mon.0) 365 : cluster [DBG] osdmap e25: 2 total, 2 up, 2 in 2024-09-17T11:06:00.641 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[19869]: cluster 2024-09-17T11:05:59.288088+0000 mon.a (mon.0) 365 : cluster [DBG] osdmap e25: 2 total, 2 up, 2 in 2024-09-17T11:06:00.641 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[19869]: cluster 2024-09-17T11:05:59.288839+0000 mon.a (mon.0) 366 : cluster [DBG] mgrmap e20: x(active, since 2s) 2024-09-17T11:06:00.641 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[19869]: cluster 2024-09-17T11:05:59.288839+0000 mon.a (mon.0) 366 : cluster [DBG] mgrmap e20: x(active, since 2s) 2024-09-17T11:06:00.958 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: debug 2024-09-17T11:06:00.632+0000 7f4193325640 -1 log_channel(cephadm) log [ERR] : [17/Sep/2024:11:06:00] ENGINE Error in HTTPServer.serve 2024-09-17T11:06:00.958 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: Traceback (most recent call last): 2024-09-17T11:06:00.958 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T11:06:00.958 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: self._connections.run(self.expiration_interval) 2024-09-17T11:06:00.958 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T11:06:00.958 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: self._run(expiration_interval) 2024-09-17T11:06:00.958 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T11:06:00.958 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T11:06:00.958 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T11:06:00.958 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T11:06:00.959 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T11:06:00.959 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: s = self.context.wrap_socket( 2024-09-17T11:06:00.959 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T11:06:00.959 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: return self.sslsocket_class._create( 2024-09-17T11:06:00.959 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T11:06:00.959 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: self.do_handshake() 2024-09-17T11:06:00.959 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T11:06:00.959 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: self._sslobj.do_handshake() 2024-09-17T11:06:00.959 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:00 smithi066 bash[20129]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T11:06:01.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: cluster 2024-09-17T11:06:00.282772+0000 mon.a (mon.0) 367 : cluster [DBG] osdmap e26: 2 total, 2 up, 2 in 2024-09-17T11:06:01.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: cluster 2024-09-17T11:06:00.282772+0000 mon.a (mon.0) 367 : cluster [DBG] osdmap e26: 2 total, 2 up, 2 in 2024-09-17T11:06:01.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: cephadm 2024-09-17T11:06:00.410848+0000 mgr.x (mgr.14263) 3 : cephadm [INF] [17/Sep/2024:11:06:00] ENGINE Bus STARTING 2024-09-17T11:06:01.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: cephadm 2024-09-17T11:06:00.410848+0000 mgr.x (mgr.14263) 3 : cephadm [INF] [17/Sep/2024:11:06:00] ENGINE Bus STARTING 2024-09-17T11:06:01.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: cephadm 2024-09-17T11:06:00.512501+0000 mgr.x (mgr.14263) 4 : cephadm [INF] [17/Sep/2024:11:06:00] ENGINE Serving on http://172.21.15.66:8765 2024-09-17T11:06:01.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: cephadm 2024-09-17T11:06:00.512501+0000 mgr.x (mgr.14263) 4 : cephadm [INF] [17/Sep/2024:11:06:00] ENGINE Serving on http://172.21.15.66:8765 2024-09-17T11:06:01.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: cephadm 2024-09-17T11:06:00.635698+0000 mgr.x (mgr.14263) 5 : cephadm [INF] [17/Sep/2024:11:06:00] ENGINE Serving on https://172.21.15.66:7150 2024-09-17T11:06:01.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: cephadm 2024-09-17T11:06:00.635698+0000 mgr.x (mgr.14263) 5 : cephadm [INF] [17/Sep/2024:11:06:00] ENGINE Serving on https://172.21.15.66:7150 2024-09-17T11:06:01.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: cephadm 2024-09-17T11:06:00.635911+0000 mgr.x (mgr.14263) 6 : cephadm [INF] [17/Sep/2024:11:06:00] ENGINE Bus STARTED 2024-09-17T11:06:01.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: cephadm 2024-09-17T11:06:00.635911+0000 mgr.x (mgr.14263) 6 : cephadm [INF] [17/Sep/2024:11:06:00] ENGINE Bus STARTED 2024-09-17T11:06:01.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: cephadm 2024-09-17T11:06:00.638111+0000 mgr.x (mgr.14263) 7 : cephadm [ERR] [17/Sep/2024:11:06:00] ENGINE Error in HTTPServer.serve 2024-09-17T11:06:01.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: Traceback (most recent call last): 2024-09-17T11:06:01.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T11:06:01.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: self._connections.run(self.expiration_interval) 2024-09-17T11:06:01.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T11:06:01.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: self._run(expiration_interval) 2024-09-17T11:06:01.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T11:06:01.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T11:06:01.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T11:06:01.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T11:06:01.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T11:06:01.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: s = self.context.wrap_socket( 2024-09-17T11:06:01.710 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T11:06:01.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: return self.sslsocket_class._create( 2024-09-17T11:06:01.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T11:06:01.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: self.do_handshake() 2024-09-17T11:06:01.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T11:06:01.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: self._sslobj.do_handshake() 2024-09-17T11:06:01.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T11:06:01.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: cephadm 2024-09-17T11:06:00.638111+0000 mgr.x (mgr.14263) 7 : cephadm [ERR] [17/Sep/2024:11:06:00] ENGINE Error in HTTPServer.serve 2024-09-17T11:06:01.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: Traceback (most recent call last): 2024-09-17T11:06:01.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T11:06:01.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: self._connections.run(self.expiration_interval) 2024-09-17T11:06:01.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T11:06:01.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: self._run(expiration_interval) 2024-09-17T11:06:01.711 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T11:06:01.712 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T11:06:01.712 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T11:06:01.712 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T11:06:01.712 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T11:06:01.712 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: s = self.context.wrap_socket( 2024-09-17T11:06:01.712 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T11:06:01.712 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: return self.sslsocket_class._create( 2024-09-17T11:06:01.712 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T11:06:01.712 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: self.do_handshake() 2024-09-17T11:06:01.712 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T11:06:01.712 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: self._sslobj.do_handshake() 2024-09-17T11:06:01.712 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:01 smithi066 bash[19869]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T11:06:02.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:02 smithi066 bash[19869]: cluster 2024-09-17T11:06:01.247700+0000 mgr.x (mgr.14263) 8 : cluster [DBG] pgmap v8: 97 pgs: 32 creating+peering, 65 active+clean; 640 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:02.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:02 smithi066 bash[19869]: cluster 2024-09-17T11:06:01.247700+0000 mgr.x (mgr.14263) 8 : cluster [DBG] pgmap v8: 97 pgs: 32 creating+peering, 65 active+clean; 640 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:02.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:02 smithi066 bash[19869]: cluster 2024-09-17T11:06:01.284549+0000 mon.a (mon.0) 368 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-17T11:06:02.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:02 smithi066 bash[19869]: cluster 2024-09-17T11:06:01.284549+0000 mon.a (mon.0) 368 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-17T11:06:02.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:02 smithi066 bash[19869]: cluster 2024-09-17T11:06:01.284599+0000 mon.a (mon.0) 369 : cluster [INF] Cluster is now healthy 2024-09-17T11:06:02.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:02 smithi066 bash[19869]: cluster 2024-09-17T11:06:01.284599+0000 mon.a (mon.0) 369 : cluster [INF] Cluster is now healthy 2024-09-17T11:06:02.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:02 smithi066 bash[19869]: cluster 2024-09-17T11:06:01.303410+0000 mon.a (mon.0) 370 : cluster [DBG] mgrmap e21: x(active, since 4s) 2024-09-17T11:06:02.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:02 smithi066 bash[19869]: cluster 2024-09-17T11:06:01.303410+0000 mon.a (mon.0) 370 : cluster [DBG] mgrmap e21: x(active, since 4s) 2024-09-17T11:06:04.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:04 smithi066 bash[19869]: cluster 2024-09-17T11:06:03.248103+0000 mgr.x (mgr.14263) 9 : cluster [DBG] pgmap v9: 97 pgs: 32 creating+peering, 65 active+clean; 640 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:04 smithi066 bash[19869]: cluster 2024-09-17T11:06:03.248103+0000 mgr.x (mgr.14263) 9 : cluster [DBG] pgmap v9: 97 pgs: 32 creating+peering, 65 active+clean; 640 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:04 smithi066 bash[19869]: audit 2024-09-17T11:06:03.401728+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:04 smithi066 bash[19869]: audit 2024-09-17T11:06:03.401728+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:04 smithi066 bash[19869]: audit 2024-09-17T11:06:03.404517+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:04 smithi066 bash[19869]: audit 2024-09-17T11:06:03.404517+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:05.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.508397+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:05.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.508397+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:05.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.511910+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:05.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.511910+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:05.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.513438+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-17T11:06:05.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.513438+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-17T11:06:05.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.514199+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-17T11:06:05.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.514199+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-17T11:06:05.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: cephadm 2024-09-17T11:06:04.514763+0000 mgr.x (mgr.14263) 10 : cephadm [INF] Adjusting osd_memory_target on smithi066 to 4536M 2024-09-17T11:06:05.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: cephadm 2024-09-17T11:06:04.514763+0000 mgr.x (mgr.14263) 10 : cephadm [INF] Adjusting osd_memory_target on smithi066 to 4536M 2024-09-17T11:06:05.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.516977+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:05.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.516977+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:05.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.519228+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:06:05.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.519228+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:06:05.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.520095+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:06:05.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.520095+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:06:05.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: cephadm 2024-09-17T11:06:04.521315+0000 mgr.x (mgr.14263) 11 : cephadm [INF] Updating smithi066:/etc/ceph/ceph.conf 2024-09-17T11:06:05.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: cephadm 2024-09-17T11:06:04.521315+0000 mgr.x (mgr.14263) 11 : cephadm [INF] Updating smithi066:/etc/ceph/ceph.conf 2024-09-17T11:06:05.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: cephadm 2024-09-17T11:06:04.616274+0000 mgr.x (mgr.14263) 12 : cephadm [INF] Updating smithi066:/var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T11:06:05.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: cephadm 2024-09-17T11:06:04.616274+0000 mgr.x (mgr.14263) 12 : cephadm [INF] Updating smithi066:/var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T11:06:05.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: cephadm 2024-09-17T11:06:04.705221+0000 mgr.x (mgr.14263) 13 : cephadm [INF] Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-17T11:06:05.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: cephadm 2024-09-17T11:06:04.705221+0000 mgr.x (mgr.14263) 13 : cephadm [INF] Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-17T11:06:05.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: cephadm 2024-09-17T11:06:04.792784+0000 mgr.x (mgr.14263) 14 : cephadm [INF] Updating smithi066:/var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T11:06:05.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: cephadm 2024-09-17T11:06:04.792784+0000 mgr.x (mgr.14263) 14 : cephadm [INF] Updating smithi066:/var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T11:06:05.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.880963+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:05.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.880963+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:05.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.887910+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:05.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.887910+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:05.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.893109+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:05.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.893109+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:05.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.913000+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:06:05.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.913000+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:06:05.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.916100+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:06:05.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.916100+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:06:05.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.917524+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:06:05.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.917524+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:06:05.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.925694+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:05.962 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:05 smithi066 bash[19869]: audit 2024-09-17T11:06:04.925694+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:07.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:06 smithi066 bash[19869]: cluster 2024-09-17T11:06:05.249150+0000 mgr.x (mgr.14263) 15 : cluster [DBG] pgmap v10: 97 pgs: 97 active+clean; 640 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 25 KiB/s rd, 441 B/s wr, 10 op/s 2024-09-17T11:06:07.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:06 smithi066 bash[19869]: cluster 2024-09-17T11:06:05.249150+0000 mgr.x (mgr.14263) 15 : cluster [DBG] pgmap v10: 97 pgs: 97 active+clean; 640 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 25 KiB/s rd, 441 B/s wr, 10 op/s 2024-09-17T11:06:09.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:08 smithi066 bash[19869]: cluster 2024-09-17T11:06:07.249823+0000 mgr.x (mgr.14263) 16 : cluster [DBG] pgmap v11: 97 pgs: 97 active+clean; 640 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 22 KiB/s rd, 383 B/s wr, 9 op/s 2024-09-17T11:06:09.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:08 smithi066 bash[19869]: cluster 2024-09-17T11:06:07.249823+0000 mgr.x (mgr.14263) 16 : cluster [DBG] pgmap v11: 97 pgs: 97 active+clean; 640 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 22 KiB/s rd, 383 B/s wr, 9 op/s 2024-09-17T11:06:11.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:10 smithi066 bash[19869]: cluster 2024-09-17T11:06:09.250880+0000 mgr.x (mgr.14263) 17 : cluster [DBG] pgmap v12: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 18 KiB/s rd, 718 B/s wr, 7 op/s 2024-09-17T11:06:11.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:10 smithi066 bash[19869]: cluster 2024-09-17T11:06:09.250880+0000 mgr.x (mgr.14263) 17 : cluster [DBG] pgmap v12: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 18 KiB/s rd, 718 B/s wr, 7 op/s 2024-09-17T11:06:13.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:12 smithi066 bash[19869]: cluster 2024-09-17T11:06:11.251516+0000 mgr.x (mgr.14263) 18 : cluster [DBG] pgmap v13: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 16 KiB/s rd, 653 B/s wr, 7 op/s 2024-09-17T11:06:13.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:12 smithi066 bash[19869]: cluster 2024-09-17T11:06:11.251516+0000 mgr.x (mgr.14263) 18 : cluster [DBG] pgmap v13: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 16 KiB/s rd, 653 B/s wr, 7 op/s 2024-09-17T11:06:15.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:14 smithi066 bash[19869]: cluster 2024-09-17T11:06:13.252202+0000 mgr.x (mgr.14263) 19 : cluster [DBG] pgmap v14: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 15 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-17T11:06:15.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:14 smithi066 bash[19869]: cluster 2024-09-17T11:06:13.252202+0000 mgr.x (mgr.14263) 19 : cluster [DBG] pgmap v14: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 15 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-17T11:06:17.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:16 smithi066 bash[19869]: cluster 2024-09-17T11:06:15.253247+0000 mgr.x (mgr.14263) 20 : cluster [DBG] pgmap v15: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 15 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-17T11:06:17.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:16 smithi066 bash[19869]: cluster 2024-09-17T11:06:15.253247+0000 mgr.x (mgr.14263) 20 : cluster [DBG] pgmap v15: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 15 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-17T11:06:19.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:18 smithi066 bash[19869]: cluster 2024-09-17T11:06:17.253894+0000 mgr.x (mgr.14263) 21 : cluster [DBG] pgmap v16: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 341 B/s wr, 0 op/s 2024-09-17T11:06:19.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:18 smithi066 bash[19869]: cluster 2024-09-17T11:06:17.253894+0000 mgr.x (mgr.14263) 21 : cluster [DBG] pgmap v16: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 341 B/s wr, 0 op/s 2024-09-17T11:06:21.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:20 smithi066 bash[19869]: cluster 2024-09-17T11:06:19.254973+0000 mgr.x (mgr.14263) 22 : cluster [DBG] pgmap v17: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 341 B/s wr, 0 op/s 2024-09-17T11:06:21.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:20 smithi066 bash[19869]: cluster 2024-09-17T11:06:19.254973+0000 mgr.x (mgr.14263) 22 : cluster [DBG] pgmap v17: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail; 341 B/s wr, 0 op/s 2024-09-17T11:06:23.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:22 smithi066 bash[19869]: cluster 2024-09-17T11:06:21.255600+0000 mgr.x (mgr.14263) 23 : cluster [DBG] pgmap v18: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:23.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:22 smithi066 bash[19869]: cluster 2024-09-17T11:06:21.255600+0000 mgr.x (mgr.14263) 23 : cluster [DBG] pgmap v18: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:25.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:24 smithi066 bash[19869]: cluster 2024-09-17T11:06:23.256250+0000 mgr.x (mgr.14263) 24 : cluster [DBG] pgmap v19: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:25.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:24 smithi066 bash[19869]: cluster 2024-09-17T11:06:23.256250+0000 mgr.x (mgr.14263) 24 : cluster [DBG] pgmap v19: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:27.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:26 smithi066 bash[19869]: cluster 2024-09-17T11:06:25.257205+0000 mgr.x (mgr.14263) 25 : cluster [DBG] pgmap v20: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:27.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:26 smithi066 bash[19869]: cluster 2024-09-17T11:06:25.257205+0000 mgr.x (mgr.14263) 25 : cluster [DBG] pgmap v20: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:28.005 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- bash -c 'ceph smb cluster create modusr1 user --define-user-pass=user1%t3stP4ss1 --define-user-pass=user2%t3stP4ss2 --placement=count:1 2024-09-17T11:06:28.005 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-09-17T11:06:29.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:28 smithi066 bash[19869]: cluster 2024-09-17T11:06:27.257828+0000 mgr.x (mgr.14263) 26 : cluster [DBG] pgmap v21: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:29.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:28 smithi066 bash[19869]: cluster 2024-09-17T11:06:27.257828+0000 mgr.x (mgr.14263) 26 : cluster [DBG] pgmap v21: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:31.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:30 smithi066 bash[19869]: cluster 2024-09-17T11:06:29.258856+0000 mgr.x (mgr.14263) 27 : cluster [DBG] pgmap v22: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:31.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:30 smithi066 bash[19869]: cluster 2024-09-17T11:06:29.258856+0000 mgr.x (mgr.14263) 27 : cluster [DBG] pgmap v22: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:32.770 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:06:33.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:32 smithi066 bash[19869]: cluster 2024-09-17T11:06:31.259456+0000 mgr.x (mgr.14263) 28 : cluster [DBG] pgmap v23: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:33.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:32 smithi066 bash[19869]: cluster 2024-09-17T11:06:31.259456+0000 mgr.x (mgr.14263) 28 : cluster [DBG] pgmap v23: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:34.370 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-17T11:06:34.370 INFO:teuthology.orchestra.run.smithi066.stdout: "resource": { 2024-09-17T11:06:34.370 INFO:teuthology.orchestra.run.smithi066.stdout: "resource_type": "ceph.smb.cluster", 2024-09-17T11:06:34.371 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_id": "modusr1", 2024-09-17T11:06:34.371 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_mode": "user", 2024-09-17T11:06:34.371 INFO:teuthology.orchestra.run.smithi066.stdout: "intent": "present", 2024-09-17T11:06:34.371 INFO:teuthology.orchestra.run.smithi066.stdout: "user_group_settings": [ 2024-09-17T11:06:34.371 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-17T11:06:34.371 INFO:teuthology.orchestra.run.smithi066.stdout: "source_type": "resource", 2024-09-17T11:06:34.371 INFO:teuthology.orchestra.run.smithi066.stdout: "ref": "modusr1ezgzovcf" 2024-09-17T11:06:34.371 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-17T11:06:34.371 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-17T11:06:34.371 INFO:teuthology.orchestra.run.smithi066.stdout: "placement": { 2024-09-17T11:06:34.371 INFO:teuthology.orchestra.run.smithi066.stdout: "count": 1 2024-09-17T11:06:34.371 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-17T11:06:34.371 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-17T11:06:34.371 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "created", 2024-09-17T11:06:34.372 INFO:teuthology.orchestra.run.smithi066.stdout: "additional_results": [ 2024-09-17T11:06:34.372 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-17T11:06:34.372 INFO:teuthology.orchestra.run.smithi066.stdout: "resource": { 2024-09-17T11:06:34.372 INFO:teuthology.orchestra.run.smithi066.stdout: "resource_type": "ceph.smb.usersgroups", 2024-09-17T11:06:34.372 INFO:teuthology.orchestra.run.smithi066.stdout: "users_groups_id": "modusr1ezgzovcf", 2024-09-17T11:06:34.372 INFO:teuthology.orchestra.run.smithi066.stdout: "intent": "present", 2024-09-17T11:06:34.372 INFO:teuthology.orchestra.run.smithi066.stdout: "values": { 2024-09-17T11:06:34.372 INFO:teuthology.orchestra.run.smithi066.stdout: "users": [ 2024-09-17T11:06:34.372 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-17T11:06:34.372 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "user1", 2024-09-17T11:06:34.372 INFO:teuthology.orchestra.run.smithi066.stdout: "password": "t3stP4ss1" 2024-09-17T11:06:34.372 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-17T11:06:34.373 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-17T11:06:34.373 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "user2", 2024-09-17T11:06:34.373 INFO:teuthology.orchestra.run.smithi066.stdout: "password": "t3stP4ss2" 2024-09-17T11:06:34.373 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-17T11:06:34.373 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-17T11:06:34.373 INFO:teuthology.orchestra.run.smithi066.stdout: "groups": [] 2024-09-17T11:06:34.373 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-17T11:06:34.373 INFO:teuthology.orchestra.run.smithi066.stdout: "linked_to_cluster": "modusr1" 2024-09-17T11:06:34.373 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-17T11:06:34.373 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "created", 2024-09-17T11:06:34.373 INFO:teuthology.orchestra.run.smithi066.stdout: "success": true 2024-09-17T11:06:34.373 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-17T11:06:34.373 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-17T11:06:34.373 INFO:teuthology.orchestra.run.smithi066.stdout: "success": true 2024-09-17T11:06:34.374 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-17T11:06:35.018 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- bash -c 'ceph smb share create modusr1 share1 cephfs / --subvolume=smb/sv1' 2024-09-17T11:06:35.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:34 smithi066 bash[19869]: cluster 2024-09-17T11:06:33.260094+0000 mgr.x (mgr.14263) 29 : cluster [DBG] pgmap v24: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:34 smithi066 bash[19869]: cluster 2024-09-17T11:06:33.260094+0000 mgr.x (mgr.14263) 29 : cluster [DBG] pgmap v24: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:34 smithi066 bash[19869]: audit 2024-09-17T11:06:34.329627+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:34 smithi066 bash[19869]: audit 2024-09-17T11:06:34.329627+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:34 smithi066 bash[19869]: audit 2024-09-17T11:06:34.359768+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:34 smithi066 bash[19869]: audit 2024-09-17T11:06:34.359768+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:34 smithi066 bash[19869]: audit 2024-09-17T11:06:34.362244+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key dump", "key": "smb/config/"} : dispatch 2024-09-17T11:06:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:34 smithi066 bash[19869]: audit 2024-09-17T11:06:34.362244+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key dump", "key": "smb/config/"} : dispatch 2024-09-17T11:06:36.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:35 smithi066 bash[19869]: audit 2024-09-17T11:06:34.284211+0000 mgr.x (mgr.14263) 30 : audit [DBG] from='client.14279 -' entity='client.admin' cmd=[{"prefix": "smb cluster create", "cluster_id": "modusr1", "auth_mode": "user", "define_user_pass": ["user1%t3stP4ss1", "user2%t3stP4ss2"], "placement": "count:1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:06:36.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:35 smithi066 bash[19869]: audit 2024-09-17T11:06:34.284211+0000 mgr.x (mgr.14263) 30 : audit [DBG] from='client.14279 -' entity='client.admin' cmd=[{"prefix": "smb cluster create", "cluster_id": "modusr1", "auth_mode": "user", "define_user_pass": ["user1%t3stP4ss1", "user2%t3stP4ss2"], "placement": "count:1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:06:37.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:36 smithi066 bash[19869]: cluster 2024-09-17T11:06:35.260951+0000 mgr.x (mgr.14263) 31 : cluster [DBG] pgmap v25: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:37.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:36 smithi066 bash[19869]: cluster 2024-09-17T11:06:35.260951+0000 mgr.x (mgr.14263) 31 : cluster [DBG] pgmap v25: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:39.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:38 smithi066 bash[19869]: cluster 2024-09-17T11:06:37.261552+0000 mgr.x (mgr.14263) 32 : cluster [DBG] pgmap v26: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:39.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:38 smithi066 bash[19869]: cluster 2024-09-17T11:06:37.261552+0000 mgr.x (mgr.14263) 32 : cluster [DBG] pgmap v26: 97 pgs: 97 active+clean; 643 KiB data, 59 MiB used, 179 GiB / 179 GiB avail 2024-09-17T11:06:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:06:41.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:40 smithi066 bash[19869]: cluster 2024-09-17T11:06:39.262715+0000 mgr.x (mgr.14263) 33 : cluster [DBG] pgmap v27: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 3.8 KiB/s rd, 113 KiB/s wr, 11 op/s 2024-09-17T11:06:41.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:40 smithi066 bash[19869]: cluster 2024-09-17T11:06:39.262715+0000 mgr.x (mgr.14263) 33 : cluster [DBG] pgmap v27: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 3.8 KiB/s rd, 113 KiB/s wr, 11 op/s 2024-09-17T11:06:41.287 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-17T11:06:41.287 INFO:teuthology.orchestra.run.smithi066.stdout: "resource": { 2024-09-17T11:06:41.287 INFO:teuthology.orchestra.run.smithi066.stdout: "resource_type": "ceph.smb.share", 2024-09-17T11:06:41.287 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_id": "modusr1", 2024-09-17T11:06:41.287 INFO:teuthology.orchestra.run.smithi066.stdout: "share_id": "share1", 2024-09-17T11:06:41.287 INFO:teuthology.orchestra.run.smithi066.stdout: "intent": "present", 2024-09-17T11:06:41.287 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "share1", 2024-09-17T11:06:41.287 INFO:teuthology.orchestra.run.smithi066.stdout: "readonly": false, 2024-09-17T11:06:41.287 INFO:teuthology.orchestra.run.smithi066.stdout: "browseable": true, 2024-09-17T11:06:41.287 INFO:teuthology.orchestra.run.smithi066.stdout: "cephfs": { 2024-09-17T11:06:41.288 INFO:teuthology.orchestra.run.smithi066.stdout: "volume": "cephfs", 2024-09-17T11:06:41.288 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-17T11:06:41.288 INFO:teuthology.orchestra.run.smithi066.stdout: "subvolumegroup": "smb", 2024-09-17T11:06:41.288 INFO:teuthology.orchestra.run.smithi066.stdout: "subvolume": "sv1", 2024-09-17T11:06:41.288 INFO:teuthology.orchestra.run.smithi066.stdout: "provider": "samba-vfs" 2024-09-17T11:06:41.288 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-17T11:06:41.288 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-17T11:06:41.288 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "created", 2024-09-17T11:06:41.288 INFO:teuthology.orchestra.run.smithi066.stdout: "success": true 2024-09-17T11:06:41.288 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-17T11:06:41.489 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[20129]: debug 2024-09-17T11:06:41.212+0000 7f41a73cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:06:41.489 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[20129]: debug 2024-09-17T11:06:41.212+0000 7f41a73cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:06:41.489 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[20129]: debug 2024-09-17T11:06:41.212+0000 7f41a73cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:06:41.489 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[20129]: debug 2024-09-17T11:06:41.212+0000 7f41a73cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:06:41.489 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[20129]: debug 2024-09-17T11:06:41.212+0000 7f41a73cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:06:41.489 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[20129]: debug 2024-09-17T11:06:41.228+0000 7f41b43e7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:06:41.489 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[20129]: debug 2024-09-17T11:06:41.228+0000 7f41b43e7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:06:41.489 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[20129]: debug 2024-09-17T11:06:41.228+0000 7f41b43e7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:06:41.489 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[20129]: debug 2024-09-17T11:06:41.228+0000 7f41b43e7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:06:41.489 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[20129]: debug 2024-09-17T11:06:41.228+0000 7f41b43e7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T11:06:42.035 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.214039+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "smb"} : dispatch 2024-09-17T11:06:42.035 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.214039+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "smb"} : dispatch 2024-09-17T11:06:42.035 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.269194+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:42.035 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.269194+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:42.035 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.271313+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key dump", "key": "smb/config/"} : dispatch 2024-09-17T11:06:42.035 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.271313+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key dump", "key": "smb/config/"} : dispatch 2024-09-17T11:06:42.036 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.272136+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.smb.fs.cluster.modusr1", "caps": ["/", "rw"]} : dispatch 2024-09-17T11:06:42.036 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.272136+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.smb.fs.cluster.modusr1", "caps": ["/", "rw"]} : dispatch 2024-09-17T11:06:42.036 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.273624+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd='[{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.smb.fs.cluster.modusr1", "caps": ["/", "rw"]}]': finished 2024-09-17T11:06:42.036 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.273624+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd='[{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.smb.fs.cluster.modusr1", "caps": ["/", "rw"]}]': finished 2024-09-17T11:06:42.036 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.282666+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:42.036 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.282666+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:42.036 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.283603+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:06:42.036 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.283603+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:06:42.036 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.285926+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:06:42.036 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.285926+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:06:42.036 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.287042+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:06:42.038 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- bash -c 'ceph smb share create modusr1 share2 cephfs / --subvolume=smb/sv2' 2024-09-17T11:06:42.038 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.287042+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:06:42.038 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.292571+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:42.038 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.292571+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:42.039 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.295516+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.smb.config.modusr1.smithi066.fdcjhb", "caps": ["mon", "allow r, allow command \"config-key get\" with \"key\" prefix \"smb/config/modusr1/\"", "osd", "allow rwx pool=.smb namespace=modusr1 object_prefix cluster.meta., allow r pool=.smb"]} : dispatch 2024-09-17T11:06:42.039 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.295516+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.smb.config.modusr1.smithi066.fdcjhb", "caps": ["mon", "allow r, allow command \"config-key get\" with \"key\" prefix \"smb/config/modusr1/\"", "osd", "allow rwx pool=.smb namespace=modusr1 object_prefix cluster.meta., allow r pool=.smb"]} : dispatch 2024-09-17T11:06:42.039 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.297157+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.smb.config.modusr1.smithi066.fdcjhb", "caps": ["mon", "allow r, allow command \"config-key get\" with \"key\" prefix \"smb/config/modusr1/\"", "osd", "allow rwx pool=.smb namespace=modusr1 object_prefix cluster.meta., allow r pool=.smb"]}]': finished 2024-09-17T11:06:42.039 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.297157+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.smb.config.modusr1.smithi066.fdcjhb", "caps": ["mon", "allow r, allow command \"config-key get\" with \"key\" prefix \"smb/config/modusr1/\"", "osd", "allow rwx pool=.smb namespace=modusr1 object_prefix cluster.meta., allow r pool=.smb"]}]': finished 2024-09-17T11:06:42.039 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.299793+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.smb.fs.cluster.modusr1"} : dispatch 2024-09-17T11:06:42.039 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.299793+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.smb.fs.cluster.modusr1"} : dispatch 2024-09-17T11:06:42.039 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.300652+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:06:42.039 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:41 smithi066 bash[19869]: audit 2024-09-17T11:06:41.300652+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:06:42.326 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:06:42.326 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:42 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:06:42.327 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:06:42 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:06:42.327 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:06:42 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:06:42.600 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:06:42 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:06:42.601 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:06:42 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:06:42.601 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:06:42 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:06:42.601 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:06:43.330 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 bash[19869]: audit 2024-09-17T11:06:41.207199+0000 mgr.x (mgr.14263) 34 : audit [DBG] from='client.14281 -' entity='client.admin' cmd=[{"prefix": "smb share create", "cluster_id": "modusr1", "share_id": "share1", "cephfs_volume": "cephfs", "path": "/", "subvolume": "smb/sv1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:06:43.330 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 bash[19869]: audit 2024-09-17T11:06:41.207199+0000 mgr.x (mgr.14263) 34 : audit [DBG] from='client.14281 -' entity='client.admin' cmd=[{"prefix": "smb share create", "cluster_id": "modusr1", "share_id": "share1", "cephfs_volume": "cephfs", "path": "/", "subvolume": "smb/sv1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:06:43.330 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 bash[19869]: audit 2024-09-17T11:06:41.215386+0000 mgr.x (mgr.14263) 35 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "smb"}]: dispatch 2024-09-17T11:06:43.330 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 bash[19869]: audit 2024-09-17T11:06:41.215386+0000 mgr.x (mgr.14263) 35 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "smb"}]: dispatch 2024-09-17T11:06:43.330 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 bash[19869]: cluster 2024-09-17T11:06:41.263085+0000 mgr.x (mgr.14263) 36 : cluster [DBG] pgmap v28: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 3.8 KiB/s rd, 113 KiB/s wr, 11 op/s 2024-09-17T11:06:43.331 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 bash[19869]: cluster 2024-09-17T11:06:41.263085+0000 mgr.x (mgr.14263) 36 : cluster [DBG] pgmap v28: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 3.8 KiB/s rd, 113 KiB/s wr, 11 op/s 2024-09-17T11:06:43.331 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 bash[19869]: cephadm 2024-09-17T11:06:41.279638+0000 mgr.x (mgr.14263) 37 : cephadm [INF] Saving service smb.modusr1 spec with placement count:1 2024-09-17T11:06:43.331 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 bash[19869]: cephadm 2024-09-17T11:06:41.279638+0000 mgr.x (mgr.14263) 37 : cephadm [INF] Saving service smb.modusr1 spec with placement count:1 2024-09-17T11:06:43.331 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 bash[19869]: cephadm 2024-09-17T11:06:41.295205+0000 mgr.x (mgr.14263) 38 : cephadm [WRN] ignoring unexpected uri scheme: 'rados:mon-config-key:smb/config/modusr1/users-groups.0.json' 2024-09-17T11:06:43.331 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 bash[19869]: cephadm 2024-09-17T11:06:41.295205+0000 mgr.x (mgr.14263) 38 : cephadm [WRN] ignoring unexpected uri scheme: 'rados:mon-config-key:smb/config/modusr1/users-groups.0.json' 2024-09-17T11:06:43.331 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 bash[19869]: cephadm 2024-09-17T11:06:41.301968+0000 mgr.x (mgr.14263) 39 : cephadm [INF] Deploying daemon smb.modusr1.smithi066.fdcjhb on smithi066 2024-09-17T11:06:43.331 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 bash[19869]: cephadm 2024-09-17T11:06:41.301968+0000 mgr.x (mgr.14263) 39 : cephadm [INF] Deploying daemon smb.modusr1.smithi066.fdcjhb on smithi066 2024-09-17T11:06:43.331 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 bash[19869]: cluster 2024-09-17T11:06:42.303804+0000 mon.a (mon.0) 404 : cluster [DBG] mgrmap e22: x(active, since 45s) 2024-09-17T11:06:43.331 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:42 smithi066 bash[19869]: cluster 2024-09-17T11:06:42.303804+0000 mon.a (mon.0) 404 : cluster [DBG] mgrmap e22: x(active, since 45s) 2024-09-17T11:06:45.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:44 smithi066 bash[19869]: cluster 2024-09-17T11:06:43.263686+0000 mgr.x (mgr.14263) 40 : cluster [DBG] pgmap v29: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 3.8 KiB/s rd, 113 KiB/s wr, 11 op/s 2024-09-17T11:06:45.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:44 smithi066 bash[19869]: cluster 2024-09-17T11:06:43.263686+0000 mgr.x (mgr.14263) 40 : cluster [DBG] pgmap v29: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 3.8 KiB/s rd, 113 KiB/s wr, 11 op/s 2024-09-17T11:06:46.817 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:06:47.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:46 smithi066 bash[19869]: cluster 2024-09-17T11:06:45.264901+0000 mgr.x (mgr.14263) 41 : cluster [DBG] pgmap v30: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 6.2 KiB/s rd, 157 KiB/s wr, 17 op/s 2024-09-17T11:06:47.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:46 smithi066 bash[19869]: cluster 2024-09-17T11:06:45.264901+0000 mgr.x (mgr.14263) 41 : cluster [DBG] pgmap v30: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 6.2 KiB/s rd, 157 KiB/s wr, 17 op/s 2024-09-17T11:06:49.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:48 smithi066 bash[19869]: cluster 2024-09-17T11:06:47.265649+0000 mgr.x (mgr.14263) 42 : cluster [DBG] pgmap v31: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 6.2 KiB/s rd, 157 KiB/s wr, 17 op/s 2024-09-17T11:06:49.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:48 smithi066 bash[19869]: cluster 2024-09-17T11:06:47.265649+0000 mgr.x (mgr.14263) 42 : cluster [DBG] pgmap v31: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 6.2 KiB/s rd, 157 KiB/s wr, 17 op/s 2024-09-17T11:06:51.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:50 smithi066 bash[19869]: cluster 2024-09-17T11:06:49.266714+0000 mgr.x (mgr.14263) 43 : cluster [DBG] pgmap v32: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 6.2 KiB/s rd, 157 KiB/s wr, 17 op/s 2024-09-17T11:06:51.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:50 smithi066 bash[19869]: cluster 2024-09-17T11:06:49.266714+0000 mgr.x (mgr.14263) 43 : cluster [DBG] pgmap v32: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 6.2 KiB/s rd, 157 KiB/s wr, 17 op/s 2024-09-17T11:06:52.765 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-17T11:06:52.765 INFO:teuthology.orchestra.run.smithi066.stdout: "resource": { 2024-09-17T11:06:52.765 INFO:teuthology.orchestra.run.smithi066.stdout: "resource_type": "ceph.smb.share", 2024-09-17T11:06:52.765 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_id": "modusr1", 2024-09-17T11:06:52.765 INFO:teuthology.orchestra.run.smithi066.stdout: "share_id": "share2", 2024-09-17T11:06:52.765 INFO:teuthology.orchestra.run.smithi066.stdout: "intent": "present", 2024-09-17T11:06:52.766 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "share2", 2024-09-17T11:06:52.766 INFO:teuthology.orchestra.run.smithi066.stdout: "readonly": false, 2024-09-17T11:06:52.766 INFO:teuthology.orchestra.run.smithi066.stdout: "browseable": true, 2024-09-17T11:06:52.766 INFO:teuthology.orchestra.run.smithi066.stdout: "cephfs": { 2024-09-17T11:06:52.766 INFO:teuthology.orchestra.run.smithi066.stdout: "volume": "cephfs", 2024-09-17T11:06:52.766 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-17T11:06:52.766 INFO:teuthology.orchestra.run.smithi066.stdout: "subvolumegroup": "smb", 2024-09-17T11:06:52.766 INFO:teuthology.orchestra.run.smithi066.stdout: "subvolume": "sv2", 2024-09-17T11:06:52.766 INFO:teuthology.orchestra.run.smithi066.stdout: "provider": "samba-vfs" 2024-09-17T11:06:52.766 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-17T11:06:52.766 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-17T11:06:52.766 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "created", 2024-09-17T11:06:52.766 INFO:teuthology.orchestra.run.smithi066.stdout: "success": true 2024-09-17T11:06:52.767 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-17T11:06:53.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:52 smithi066 bash[19869]: cluster 2024-09-17T11:06:51.267336+0000 mgr.x (mgr.14263) 44 : cluster [DBG] pgmap v33: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.4 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:06:53.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:52 smithi066 bash[19869]: cluster 2024-09-17T11:06:51.267336+0000 mgr.x (mgr.14263) 44 : cluster [DBG] pgmap v33: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.4 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:06:53.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:52 smithi066 bash[19869]: audit 2024-09-17T11:06:52.708220+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv2", "group_name": "smb"} : dispatch 2024-09-17T11:06:53.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:52 smithi066 bash[19869]: audit 2024-09-17T11:06:52.708220+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv2", "group_name": "smb"} : dispatch 2024-09-17T11:06:53.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:52 smithi066 bash[19869]: audit 2024-09-17T11:06:52.745769+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:53.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:52 smithi066 bash[19869]: audit 2024-09-17T11:06:52.745769+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:53.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:52 smithi066 bash[19869]: audit 2024-09-17T11:06:52.747019+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "smb"} : dispatch 2024-09-17T11:06:53.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:52 smithi066 bash[19869]: audit 2024-09-17T11:06:52.747019+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "smb"} : dispatch 2024-09-17T11:06:53.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:52 smithi066 bash[19869]: audit 2024-09-17T11:06:52.754179+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key dump", "key": "smb/config/"} : dispatch 2024-09-17T11:06:53.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:52 smithi066 bash[19869]: audit 2024-09-17T11:06:52.754179+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key dump", "key": "smb/config/"} : dispatch 2024-09-17T11:06:53.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:52 smithi066 bash[19869]: audit 2024-09-17T11:06:52.754958+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.smb.fs.cluster.modusr1", "caps": ["/", "rw"]} : dispatch 2024-09-17T11:06:53.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:52 smithi066 bash[19869]: audit 2024-09-17T11:06:52.754958+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.smb.fs.cluster.modusr1", "caps": ["/", "rw"]} : dispatch 2024-09-17T11:06:53.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:52 smithi066 bash[19869]: audit 2024-09-17T11:06:52.761766+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:53.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:52 smithi066 bash[19869]: audit 2024-09-17T11:06:52.761766+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:06:54.106 INFO:teuthology.run_tasks:Running task cephadm.wait_for_service... 2024-09-17T11:06:54.118 INFO:tasks.cephadm:Waiting for ceph service smb.modusr1 to start (timeout 300)... 2024-09-17T11:06:54.119 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph orch ls -f json 2024-09-17T11:06:54.457 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:53 smithi066 bash[19869]: audit 2024-09-17T11:06:52.703463+0000 mgr.x (mgr.14263) 45 : audit [DBG] from='client.14287 -' entity='client.admin' cmd=[{"prefix": "smb share create", "cluster_id": "modusr1", "share_id": "share2", "cephfs_volume": "cephfs", "path": "/", "subvolume": "smb/sv2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:06:54.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:53 smithi066 bash[19869]: audit 2024-09-17T11:06:52.703463+0000 mgr.x (mgr.14263) 45 : audit [DBG] from='client.14287 -' entity='client.admin' cmd=[{"prefix": "smb share create", "cluster_id": "modusr1", "share_id": "share2", "cephfs_volume": "cephfs", "path": "/", "subvolume": "smb/sv2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:06:54.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:53 smithi066 bash[19869]: audit 2024-09-17T11:06:52.709469+0000 mgr.x (mgr.14263) 46 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv2", "group_name": "smb"}]: dispatch 2024-09-17T11:06:54.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:53 smithi066 bash[19869]: audit 2024-09-17T11:06:52.709469+0000 mgr.x (mgr.14263) 46 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv2", "group_name": "smb"}]: dispatch 2024-09-17T11:06:54.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:53 smithi066 bash[19869]: audit 2024-09-17T11:06:52.747926+0000 mgr.x (mgr.14263) 47 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "smb"}]: dispatch 2024-09-17T11:06:54.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:53 smithi066 bash[19869]: audit 2024-09-17T11:06:52.747926+0000 mgr.x (mgr.14263) 47 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "smb"}]: dispatch 2024-09-17T11:06:54.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:53 smithi066 bash[19869]: cephadm 2024-09-17T11:06:52.759265+0000 mgr.x (mgr.14263) 48 : cephadm [INF] Saving service smb.modusr1 spec with placement count:1 2024-09-17T11:06:54.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:53 smithi066 bash[19869]: cephadm 2024-09-17T11:06:52.759265+0000 mgr.x (mgr.14263) 48 : cephadm [INF] Saving service smb.modusr1 spec with placement count:1 2024-09-17T11:06:54.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:53 smithi066 bash[19869]: cluster 2024-09-17T11:06:53.267775+0000 mgr.x (mgr.14263) 49 : cluster [DBG] pgmap v34: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.4 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:06:54.458 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:53 smithi066 bash[19869]: cluster 2024-09-17T11:06:53.267775+0000 mgr.x (mgr.14263) 49 : cluster [DBG] pgmap v34: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.4 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:06:56.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:56 smithi066 bash[19869]: cluster 2024-09-17T11:06:55.268775+0000 mgr.x (mgr.14263) 50 : cluster [DBG] pgmap v35: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 4.8 KiB/s rd, 88 KiB/s wr, 11 op/s 2024-09-17T11:06:56.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:56 smithi066 bash[19869]: cluster 2024-09-17T11:06:55.268775+0000 mgr.x (mgr.14263) 50 : cluster [DBG] pgmap v35: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 4.8 KiB/s rd, 88 KiB/s wr, 11 op/s 2024-09-17T11:06:58.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:58 smithi066 bash[19869]: cluster 2024-09-17T11:06:57.269370+0000 mgr.x (mgr.14263) 51 : cluster [DBG] pgmap v36: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.4 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:06:58.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:06:58 smithi066 bash[19869]: cluster 2024-09-17T11:06:57.269370+0000 mgr.x (mgr.14263) 51 : cluster [DBG] pgmap v36: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.4 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:06:58.933 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:07:00.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:00 smithi066 bash[19869]: cluster 2024-09-17T11:06:59.270491+0000 mgr.x (mgr.14263) 52 : cluster [DBG] pgmap v37: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.4 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:07:00.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:00 smithi066 bash[19869]: cluster 2024-09-17T11:06:59.270491+0000 mgr.x (mgr.14263) 52 : cluster [DBG] pgmap v37: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.4 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:07:01.738 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:07:01.739 INFO:teuthology.orchestra.run.smithi066.stdout:[{"placement": {"count": 2}, "service_id": "cephfs", "service_name": "mds.cephfs", "service_type": "mds", "status": {"created": "2024-09-17T11:05:06.330020Z", "last_refresh": "2024-09-17T11:06:03.398292Z", "running": 2, "size": 2}}, {"placement": {"count": 1, "hosts": ["smithi066=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2024-09-17T11:01:36.809564Z", "last_refresh": "2024-09-17T11:06:03.397944Z", "running": 1, "size": 1}}, {"placement": {"count": 1, "hosts": ["smithi066:172.21.15.66=a"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2024-09-17T11:01:16.208618Z", "last_refresh": "2024-09-17T11:06:03.397802Z", "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "6c1fcab85602ba9d6ddde3c89adee6ee0382b7527a8ed3ee372c969068775c76", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d1ee255599fffe6c832aeedeed0b06c298863896564017e014e180f38b9ae1bb", "last_refresh": "2024-09-17T11:06:03.398058Z", "running": 2, "size": 2}, "unmanaged": true}, {"events": ["2024-09-17T11:06:52.761971Z service:smb.modusr1 [INFO] \"service was created\""], "placement": {"count": 1}, "service_id": "modusr1", "service_name": "smb.modusr1", "service_type": "smb", "spec": {"cluster_id": "modusr1", "config_uri": "rados://.smb/modusr1/config.smb", "include_ceph_users": ["client.smb.fs.cluster.modusr1"], "user_sources": ["rados:mon-config-key:smb/config/modusr1/users-groups.0.json"]}, "status": {"created": "2024-09-17T11:06:52.759280Z", "running": 0, "size": 1}}] 2024-09-17T11:07:02.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:02 smithi066 bash[19869]: cluster 2024-09-17T11:07:01.271160+0000 mgr.x (mgr.14263) 53 : cluster [DBG] pgmap v38: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.4 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:07:02.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:02 smithi066 bash[19869]: cluster 2024-09-17T11:07:01.271160+0000 mgr.x (mgr.14263) 53 : cluster [DBG] pgmap v38: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.4 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:07:02.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:02 smithi066 bash[19869]: audit 2024-09-17T11:07:01.735048+0000 mgr.x (mgr.14263) 54 : audit [DBG] from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T11:07:02.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:02 smithi066 bash[19869]: audit 2024-09-17T11:07:01.735048+0000 mgr.x (mgr.14263) 54 : audit [DBG] from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T11:07:02.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:02 smithi066 bash[19869]: audit 2024-09-17T11:07:01.985998+0000 mon.a (mon.0) 411 : audit [DBG] from='client.? 172.17.0.2:0/733328906' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:02.546 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:02 smithi066 bash[19869]: audit 2024-09-17T11:07:01.985998+0000 mon.a (mon.0) 411 : audit [DBG] from='client.? 172.17.0.2:0/733328906' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:02.547 INFO:tasks.cephadm:smb.modusr1 has 0/1 2024-09-17T11:07:03.548 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph orch ls -f json 2024-09-17T11:07:04.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:04 smithi066 bash[19869]: cluster 2024-09-17T11:07:03.271746+0000 mgr.x (mgr.14263) 55 : cluster [DBG] pgmap v39: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.4 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:07:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:04 smithi066 bash[19869]: cluster 2024-09-17T11:07:03.271746+0000 mgr.x (mgr.14263) 55 : cluster [DBG] pgmap v39: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.4 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:07:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:04 smithi066 bash[19869]: audit 2024-09-17T11:07:03.438479+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:04 smithi066 bash[19869]: audit 2024-09-17T11:07:03.438479+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:04 smithi066 bash[19869]: audit 2024-09-17T11:07:03.444857+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:04 smithi066 bash[19869]: audit 2024-09-17T11:07:03.444857+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:04 smithi066 bash[19869]: audit 2024-09-17T11:07:03.450805+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:04 smithi066 bash[19869]: audit 2024-09-17T11:07:03.450805+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:04 smithi066 bash[19869]: audit 2024-09-17T11:07:03.456348+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:04 smithi066 bash[19869]: audit 2024-09-17T11:07:03.456348+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:04.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:04 smithi066 bash[19869]: audit 2024-09-17T11:07:03.465285+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:07:04.709 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:04 smithi066 bash[19869]: audit 2024-09-17T11:07:03.465285+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:07:05.707 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:05 smithi066 bash[19869]: audit 2024-09-17T11:07:05.187491+0000 mon.a (mon.0) 417 : audit [DBG] from='client.? 172.17.0.2:0/184221962' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:05.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:05 smithi066 bash[19869]: audit 2024-09-17T11:07:05.187491+0000 mon.a (mon.0) 417 : audit [DBG] from='client.? 172.17.0.2:0/184221962' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:06.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:06 smithi066 bash[19869]: cluster 2024-09-17T11:07:05.272426+0000 mgr.x (mgr.14263) 56 : cluster [DBG] pgmap v40: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.6 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:07:06.708 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:06 smithi066 bash[19869]: cluster 2024-09-17T11:07:05.272426+0000 mgr.x (mgr.14263) 56 : cluster [DBG] pgmap v40: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.6 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:07:09.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:08 smithi066 bash[19869]: cluster 2024-09-17T11:07:07.272958+0000 mgr.x (mgr.14263) 57 : cluster [DBG] pgmap v41: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 170 B/s rd, 85 B/s wr, 0 op/s 2024-09-17T11:07:09.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:08 smithi066 bash[19869]: cluster 2024-09-17T11:07:07.272958+0000 mgr.x (mgr.14263) 57 : cluster [DBG] pgmap v41: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 170 B/s rd, 85 B/s wr, 0 op/s 2024-09-17T11:07:09.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:08 smithi066 bash[19869]: audit 2024-09-17T11:07:07.761788+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:09.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:08 smithi066 bash[19869]: audit 2024-09-17T11:07:07.761788+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:09.308 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:07:11.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: cluster 2024-09-17T11:07:09.274092+0000 mgr.x (mgr.14263) 58 : cluster [DBG] pgmap v42: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 85 B/s wr, 0 op/s 2024-09-17T11:07:11.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: cluster 2024-09-17T11:07:09.274092+0000 mgr.x (mgr.14263) 58 : cluster [DBG] pgmap v42: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 85 B/s wr, 0 op/s 2024-09-17T11:07:11.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:09.755330+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:11.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:09.755330+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:11.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:09.758849+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:11.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:09.758849+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:11.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:10.396069+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:07:11.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:10.396069+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:07:11.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:10.397448+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:07:11.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:10.397448+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:07:11.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:10.404638+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:11.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:10.404638+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:11.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:10.418508+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:07:11.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:10.418508+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:07:11.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:10.420998+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:07:11.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:10.420998+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:07:11.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:10.422363+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:07:11.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:10.422363+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:07:11.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:10.428326+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:11.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:10 smithi066 bash[19869]: audit 2024-09-17T11:07:10.428326+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:13.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:12 smithi066 bash[19869]: cluster 2024-09-17T11:07:11.274729+0000 mgr.x (mgr.14263) 59 : cluster [DBG] pgmap v43: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T11:07:13.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:12 smithi066 bash[19869]: cluster 2024-09-17T11:07:11.274729+0000 mgr.x (mgr.14263) 59 : cluster [DBG] pgmap v43: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T11:07:15.114 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:14 smithi066 bash[19869]: cluster 2024-09-17T11:07:13.275351+0000 mgr.x (mgr.14263) 60 : cluster [DBG] pgmap v44: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T11:07:15.114 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:14 smithi066 bash[19869]: cluster 2024-09-17T11:07:13.275351+0000 mgr.x (mgr.14263) 60 : cluster [DBG] pgmap v44: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T11:07:15.730 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:07:15.730 INFO:teuthology.orchestra.run.smithi066.stdout:[{"placement": {"count": 2}, "service_id": "cephfs", "service_name": "mds.cephfs", "service_type": "mds", "status": {"created": "2024-09-17T11:05:06.330020Z", "last_refresh": "2024-09-17T11:07:09.751662Z", "running": 2, "size": 2}}, {"placement": {"count": 1, "hosts": ["smithi066=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2024-09-17T11:01:36.809564Z", "last_refresh": "2024-09-17T11:07:09.751339Z", "running": 1, "size": 1}}, {"placement": {"count": 1, "hosts": ["smithi066:172.21.15.66=a"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2024-09-17T11:01:16.208618Z", "last_refresh": "2024-09-17T11:07:09.751211Z", "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "6c1fcab85602ba9d6ddde3c89adee6ee0382b7527a8ed3ee372c969068775c76", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d1ee255599fffe6c832aeedeed0b06c298863896564017e014e180f38b9ae1bb", "last_refresh": "2024-09-17T11:07:09.751448Z", "running": 2, "size": 2}, "unmanaged": true}, {"events": ["2024-09-17T11:07:03.456578Z service:smb.modusr1 [INFO] \"service was created\""], "placement": {"count": 1}, "service_id": "modusr1", "service_name": "smb.modusr1", "service_type": "smb", "spec": {"cluster_id": "modusr1", "config_uri": "rados://.smb/modusr1/config.smb", "include_ceph_users": ["client.smb.fs.cluster.modusr1"], "user_sources": ["rados:mon-config-key:smb/config/modusr1/users-groups.0.json"]}, "status": {"created": "2024-09-17T11:06:52.759280Z", "last_refresh": "2024-09-17T11:07:09.751896Z", "running": 1, "size": 1}}] 2024-09-17T11:07:16.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:15 smithi066 bash[19869]: audit 2024-09-17T11:07:15.352057+0000 mon.a (mon.0) 428 : audit [DBG] from='client.? 172.17.0.2:0/2330315719' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:16.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:15 smithi066 bash[19869]: audit 2024-09-17T11:07:15.352057+0000 mon.a (mon.0) 428 : audit [DBG] from='client.? 172.17.0.2:0/2330315719' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:16.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:15 smithi066 bash[19869]: audit 2024-09-17T11:07:15.382975+0000 mon.a (mon.0) 429 : audit [DBG] from='client.? 172.17.0.2:0/567102871' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:16.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:15 smithi066 bash[19869]: audit 2024-09-17T11:07:15.382975+0000 mon.a (mon.0) 429 : audit [DBG] from='client.? 172.17.0.2:0/567102871' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:17.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:16 smithi066 bash[19869]: cluster 2024-09-17T11:07:15.275999+0000 mgr.x (mgr.14263) 61 : cluster [DBG] pgmap v45: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T11:07:17.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:16 smithi066 bash[19869]: cluster 2024-09-17T11:07:15.275999+0000 mgr.x (mgr.14263) 61 : cluster [DBG] pgmap v45: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T11:07:17.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:16 smithi066 bash[19869]: audit 2024-09-17T11:07:15.726386+0000 mgr.x (mgr.14263) 62 : audit [DBG] from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T11:07:17.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:16 smithi066 bash[19869]: audit 2024-09-17T11:07:15.726386+0000 mgr.x (mgr.14263) 62 : audit [DBG] from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T11:07:17.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:16 smithi066 bash[19869]: audit 2024-09-17T11:07:16.415489+0000 mon.a (mon.0) 430 : audit [DBG] from='client.? 172.17.0.2:0/3920239392' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:17.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:16 smithi066 bash[19869]: audit 2024-09-17T11:07:16.415489+0000 mon.a (mon.0) 430 : audit [DBG] from='client.? 172.17.0.2:0/3920239392' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:17.721 INFO:tasks.cephadm:smb.modusr1 has 1/1 2024-09-17T11:07:17.722 INFO:teuthology.run_tasks:Running task cephadm.exec... 2024-09-17T11:07:17.732 INFO:tasks.cephadm:Running commands on role host.b host ubuntu@smithi161.front.sepia.ceph.com 2024-09-17T11:07:17.732 DEBUG:teuthology.orchestra.run.smithi161:> sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'sleep 30' 2024-09-17T11:07:17.747 INFO:teuthology.orchestra.run.smithi161.stderr:+ sleep 30 2024-09-17T11:07:18.202 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:17 smithi066 bash[19869]: audit 2024-09-17T11:07:17.455774+0000 mon.a (mon.0) 431 : audit [DBG] from='client.? 172.17.0.2:0/3949820310' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:18.202 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:17 smithi066 bash[19869]: audit 2024-09-17T11:07:17.455774+0000 mon.a (mon.0) 431 : audit [DBG] from='client.? 172.17.0.2:0/3949820310' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:19.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:18 smithi066 bash[19869]: cluster 2024-09-17T11:07:17.276499+0000 mgr.x (mgr.14263) 63 : cluster [DBG] pgmap v46: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 170 B/s rd, 0 op/s 2024-09-17T11:07:19.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:18 smithi066 bash[19869]: cluster 2024-09-17T11:07:17.276499+0000 mgr.x (mgr.14263) 63 : cluster [DBG] pgmap v46: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 170 B/s rd, 0 op/s 2024-09-17T11:07:19.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:18 smithi066 bash[19869]: audit 2024-09-17T11:07:18.488854+0000 mon.a (mon.0) 432 : audit [DBG] from='client.? 172.17.0.2:0/1648791273' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:19.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:18 smithi066 bash[19869]: audit 2024-09-17T11:07:18.488854+0000 mon.a (mon.0) 432 : audit [DBG] from='client.? 172.17.0.2:0/1648791273' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:20.053 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:19 smithi066 bash[19869]: audit 2024-09-17T11:07:19.529858+0000 mon.a (mon.0) 433 : audit [DBG] from='client.? 172.17.0.2:0/1046562056' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:20.054 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:19 smithi066 bash[19869]: audit 2024-09-17T11:07:19.529858+0000 mon.a (mon.0) 433 : audit [DBG] from='client.? 172.17.0.2:0/1046562056' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:21.289 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:20 smithi066 bash[19869]: cluster 2024-09-17T11:07:19.277481+0000 mgr.x (mgr.14263) 64 : cluster [DBG] pgmap v47: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T11:07:21.289 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:20 smithi066 bash[19869]: cluster 2024-09-17T11:07:19.277481+0000 mgr.x (mgr.14263) 64 : cluster [DBG] pgmap v47: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T11:07:21.289 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:20 smithi066 bash[19869]: audit 2024-09-17T11:07:20.565561+0000 mon.a (mon.0) 434 : audit [DBG] from='client.? 172.17.0.2:0/3636948413' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:21.289 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:20 smithi066 bash[19869]: audit 2024-09-17T11:07:20.565561+0000 mon.a (mon.0) 434 : audit [DBG] from='client.? 172.17.0.2:0/3636948413' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:22.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:21 smithi066 bash[19869]: audit 2024-09-17T11:07:21.601592+0000 mon.a (mon.0) 435 : audit [DBG] from='client.? 172.17.0.2:0/3109056562' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:22.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:21 smithi066 bash[19869]: audit 2024-09-17T11:07:21.601592+0000 mon.a (mon.0) 435 : audit [DBG] from='client.? 172.17.0.2:0/3109056562' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:23.146 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:22 smithi066 bash[19869]: cluster 2024-09-17T11:07:21.278077+0000 mgr.x (mgr.14263) 65 : cluster [DBG] pgmap v48: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 682 B/s rd, 0 op/s 2024-09-17T11:07:23.146 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:22 smithi066 bash[19869]: cluster 2024-09-17T11:07:21.278077+0000 mgr.x (mgr.14263) 65 : cluster [DBG] pgmap v48: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 682 B/s rd, 0 op/s 2024-09-17T11:07:23.146 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:22 smithi066 bash[19869]: audit 2024-09-17T11:07:22.635914+0000 mon.a (mon.0) 436 : audit [DBG] from='client.? 172.17.0.2:0/2794689141' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:23.146 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:22 smithi066 bash[19869]: audit 2024-09-17T11:07:22.635914+0000 mon.a (mon.0) 436 : audit [DBG] from='client.? 172.17.0.2:0/2794689141' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:24.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:23 smithi066 bash[19869]: audit 2024-09-17T11:07:23.669526+0000 mon.a (mon.0) 437 : audit [DBG] from='client.? 172.17.0.2:0/2066627121' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:24.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:23 smithi066 bash[19869]: audit 2024-09-17T11:07:23.669526+0000 mon.a (mon.0) 437 : audit [DBG] from='client.? 172.17.0.2:0/2066627121' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:25.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:24 smithi066 bash[19869]: cluster 2024-09-17T11:07:23.278668+0000 mgr.x (mgr.14263) 66 : cluster [DBG] pgmap v49: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 682 B/s rd, 0 op/s 2024-09-17T11:07:25.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:24 smithi066 bash[19869]: cluster 2024-09-17T11:07:23.278668+0000 mgr.x (mgr.14263) 66 : cluster [DBG] pgmap v49: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 682 B/s rd, 0 op/s 2024-09-17T11:07:25.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:24 smithi066 bash[19869]: audit 2024-09-17T11:07:24.702099+0000 mon.a (mon.0) 438 : audit [DBG] from='client.? 172.17.0.2:0/4233006290' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:25.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:24 smithi066 bash[19869]: audit 2024-09-17T11:07:24.702099+0000 mon.a (mon.0) 438 : audit [DBG] from='client.? 172.17.0.2:0/4233006290' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:26.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:25 smithi066 bash[19869]: audit 2024-09-17T11:07:25.738840+0000 mon.a (mon.0) 439 : audit [DBG] from='client.? 172.17.0.2:0/1846053215' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:26.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:25 smithi066 bash[19869]: audit 2024-09-17T11:07:25.738840+0000 mon.a (mon.0) 439 : audit [DBG] from='client.? 172.17.0.2:0/1846053215' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:27.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:26 smithi066 bash[19869]: cluster 2024-09-17T11:07:25.279699+0000 mgr.x (mgr.14263) 67 : cluster [DBG] pgmap v50: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T11:07:27.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:26 smithi066 bash[19869]: cluster 2024-09-17T11:07:25.279699+0000 mgr.x (mgr.14263) 67 : cluster [DBG] pgmap v50: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T11:07:27.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:26 smithi066 bash[19869]: audit 2024-09-17T11:07:26.772881+0000 mon.a (mon.0) 440 : audit [DBG] from='client.? 172.17.0.2:0/994683276' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:27.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:26 smithi066 bash[19869]: audit 2024-09-17T11:07:26.772881+0000 mon.a (mon.0) 440 : audit [DBG] from='client.? 172.17.0.2:0/994683276' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:29.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:28 smithi066 bash[19869]: cluster 2024-09-17T11:07:27.280318+0000 mgr.x (mgr.14263) 68 : cluster [DBG] pgmap v51: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T11:07:29.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:28 smithi066 bash[19869]: cluster 2024-09-17T11:07:27.280318+0000 mgr.x (mgr.14263) 68 : cluster [DBG] pgmap v51: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T11:07:31.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:30 smithi066 bash[19869]: cluster 2024-09-17T11:07:29.281331+0000 mgr.x (mgr.14263) 69 : cluster [DBG] pgmap v52: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-17T11:07:31.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:30 smithi066 bash[19869]: cluster 2024-09-17T11:07:29.281331+0000 mgr.x (mgr.14263) 69 : cluster [DBG] pgmap v52: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-17T11:07:32.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:31 smithi066 bash[19869]: cluster 2024-09-17T11:07:30.848042+0000 mon.a (mon.0) 441 : cluster [DBG] mgrmap e23: x(active, since 93s) 2024-09-17T11:07:32.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:31 smithi066 bash[19869]: cluster 2024-09-17T11:07:30.848042+0000 mon.a (mon.0) 441 : cluster [DBG] mgrmap e23: x(active, since 93s) 2024-09-17T11:07:32.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:31 smithi066 bash[19869]: audit 2024-09-17T11:07:31.809830+0000 mon.a (mon.0) 442 : audit [DBG] from='client.? 172.17.0.2:0/4000778895' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:32.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:31 smithi066 bash[19869]: audit 2024-09-17T11:07:31.809830+0000 mon.a (mon.0) 442 : audit [DBG] from='client.? 172.17.0.2:0/4000778895' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:33.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:32 smithi066 bash[19869]: cluster 2024-09-17T11:07:31.281938+0000 mgr.x (mgr.14263) 70 : cluster [DBG] pgmap v53: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T11:07:33.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:32 smithi066 bash[19869]: cluster 2024-09-17T11:07:31.281938+0000 mgr.x (mgr.14263) 70 : cluster [DBG] pgmap v53: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T11:07:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:34 smithi066 bash[19869]: cluster 2024-09-17T11:07:33.282518+0000 mgr.x (mgr.14263) 71 : cluster [DBG] pgmap v54: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T11:07:35.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:34 smithi066 bash[19869]: cluster 2024-09-17T11:07:33.282518+0000 mgr.x (mgr.14263) 71 : cluster [DBG] pgmap v54: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T11:07:37.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:36 smithi066 bash[19869]: cluster 2024-09-17T11:07:35.283503+0000 mgr.x (mgr.14263) 72 : cluster [DBG] pgmap v55: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T11:07:37.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:36 smithi066 bash[19869]: cluster 2024-09-17T11:07:35.283503+0000 mgr.x (mgr.14263) 72 : cluster [DBG] pgmap v55: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-17T11:07:37.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:36 smithi066 bash[19869]: audit 2024-09-17T11:07:36.846368+0000 mon.a (mon.0) 443 : audit [DBG] from='client.? 172.17.0.2:0/968569942' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:37.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:36 smithi066 bash[19869]: audit 2024-09-17T11:07:36.846368+0000 mon.a (mon.0) 443 : audit [DBG] from='client.? 172.17.0.2:0/968569942' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:39.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:38 smithi066 bash[19869]: cluster 2024-09-17T11:07:37.284241+0000 mgr.x (mgr.14263) 73 : cluster [DBG] pgmap v56: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 852 B/s rd, 255 B/s wr, 1 op/s 2024-09-17T11:07:39.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:38 smithi066 bash[19869]: cluster 2024-09-17T11:07:37.284241+0000 mgr.x (mgr.14263) 73 : cluster [DBG] pgmap v56: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 852 B/s rd, 255 B/s wr, 1 op/s 2024-09-17T11:07:41.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:40 smithi066 bash[19869]: cluster 2024-09-17T11:07:39.285276+0000 mgr.x (mgr.14263) 74 : cluster [DBG] pgmap v57: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-17T11:07:41.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:40 smithi066 bash[19869]: cluster 2024-09-17T11:07:39.285276+0000 mgr.x (mgr.14263) 74 : cluster [DBG] pgmap v57: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-17T11:07:43.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:42 smithi066 bash[19869]: cluster 2024-09-17T11:07:41.285970+0000 mgr.x (mgr.14263) 75 : cluster [DBG] pgmap v58: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 255 B/s wr, 0 op/s 2024-09-17T11:07:43.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:42 smithi066 bash[19869]: cluster 2024-09-17T11:07:41.285970+0000 mgr.x (mgr.14263) 75 : cluster [DBG] pgmap v58: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 255 B/s wr, 0 op/s 2024-09-17T11:07:43.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:42 smithi066 bash[19869]: audit 2024-09-17T11:07:41.886094+0000 mon.a (mon.0) 444 : audit [DBG] from='client.? 172.17.0.2:0/1571516870' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:43.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:42 smithi066 bash[19869]: audit 2024-09-17T11:07:41.886094+0000 mon.a (mon.0) 444 : audit [DBG] from='client.? 172.17.0.2:0/1571516870' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:45.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:44 smithi066 bash[19869]: cluster 2024-09-17T11:07:43.286546+0000 mgr.x (mgr.14263) 76 : cluster [DBG] pgmap v59: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 255 B/s wr, 0 op/s 2024-09-17T11:07:45.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:44 smithi066 bash[19869]: cluster 2024-09-17T11:07:43.286546+0000 mgr.x (mgr.14263) 76 : cluster [DBG] pgmap v59: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 255 B/s wr, 0 op/s 2024-09-17T11:07:47.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:46 smithi066 bash[19869]: cluster 2024-09-17T11:07:45.287541+0000 mgr.x (mgr.14263) 77 : cluster [DBG] pgmap v60: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 511 B/s rd, 255 B/s wr, 0 op/s 2024-09-17T11:07:47.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:46 smithi066 bash[19869]: cluster 2024-09-17T11:07:45.287541+0000 mgr.x (mgr.14263) 77 : cluster [DBG] pgmap v60: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 511 B/s rd, 255 B/s wr, 0 op/s 2024-09-17T11:07:47.760 DEBUG:teuthology.orchestra.run.smithi161:> sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'sudo docker run --rm --net=host -eKRB5_CONFIG=/dev/null quay.io/samba.org/samba-client:latest smbclient -U user1%t3stP4ss1 //172.21.15.66/share1 -c ls' 2024-09-17T11:07:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo docker run --rm --net=host -eKRB5_CONFIG=/dev/null quay.io/samba.org/samba-client:latest smbclient -U user1%t3stP4ss1 //172.21.15.66/share1 -c ls 2024-09-17T11:07:48.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:47 smithi066 bash[19869]: audit 2024-09-17T11:07:46.924198+0000 mon.a (mon.0) 445 : audit [DBG] from='client.? 172.17.0.2:0/1737462778' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:48.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:47 smithi066 bash[19869]: audit 2024-09-17T11:07:46.924198+0000 mon.a (mon.0) 445 : audit [DBG] from='client.? 172.17.0.2:0/1737462778' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:48.769 INFO:teuthology.orchestra.run.smithi161.stdout: . D 0 Tue Sep 17 11:05:36 2024 2024-09-17T11:07:48.769 INFO:teuthology.orchestra.run.smithi161.stdout: .. D 0 Tue Sep 17 11:05:36 2024 2024-09-17T11:07:48.769 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T11:07:48.769 INFO:teuthology.orchestra.run.smithi161.stdout: 89022464 blocks of size 1024. 89022464 blocks available 2024-09-17T11:07:49.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:48 smithi066 bash[19869]: cluster 2024-09-17T11:07:47.288272+0000 mgr.x (mgr.14263) 78 : cluster [DBG] pgmap v61: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T11:07:49.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:48 smithi066 bash[19869]: cluster 2024-09-17T11:07:47.288272+0000 mgr.x (mgr.14263) 78 : cluster [DBG] pgmap v61: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T11:07:49.280 DEBUG:teuthology.orchestra.run.smithi161:> sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'sudo docker run --rm --net=host -eKRB5_CONFIG=/dev/null quay.io/samba.org/samba-client:latest smbclient -U user2%t3stP4ss2 //172.21.15.66/share2 -c ls' 2024-09-17T11:07:49.331 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo docker run --rm --net=host -eKRB5_CONFIG=/dev/null quay.io/samba.org/samba-client:latest smbclient -U user2%t3stP4ss2 //172.21.15.66/share2 -c ls 2024-09-17T11:07:50.278 INFO:teuthology.orchestra.run.smithi161.stdout: . D 0 Tue Sep 17 11:05:43 2024 2024-09-17T11:07:50.278 INFO:teuthology.orchestra.run.smithi161.stdout: .. D 0 Tue Sep 17 11:05:43 2024 2024-09-17T11:07:50.278 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T11:07:50.278 INFO:teuthology.orchestra.run.smithi161.stdout: 89022464 blocks of size 1024. 89022464 blocks available 2024-09-17T11:07:50.750 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T11:07:50.759 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-17T11:07:50.760 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- bash -c 'ceph smb share rm modusr1 share2' 2024-09-17T11:07:51.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:50 smithi066 bash[19869]: cluster 2024-09-17T11:07:49.289428+0000 mgr.x (mgr.14263) 79 : cluster [DBG] pgmap v62: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 511 B/s rd, 0 op/s 2024-09-17T11:07:51.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:50 smithi066 bash[19869]: cluster 2024-09-17T11:07:49.289428+0000 mgr.x (mgr.14263) 79 : cluster [DBG] pgmap v62: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 511 B/s rd, 0 op/s 2024-09-17T11:07:53.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:52 smithi066 bash[19869]: cluster 2024-09-17T11:07:51.290169+0000 mgr.x (mgr.14263) 80 : cluster [DBG] pgmap v63: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T11:07:53.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:52 smithi066 bash[19869]: cluster 2024-09-17T11:07:51.290169+0000 mgr.x (mgr.14263) 80 : cluster [DBG] pgmap v63: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T11:07:53.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:52 smithi066 bash[19869]: audit 2024-09-17T11:07:51.962469+0000 mon.a (mon.0) 446 : audit [DBG] from='client.? 172.17.0.2:0/1831041433' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:53.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:52 smithi066 bash[19869]: audit 2024-09-17T11:07:51.962469+0000 mon.a (mon.0) 446 : audit [DBG] from='client.? 172.17.0.2:0/1831041433' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:55.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:54 smithi066 bash[19869]: cluster 2024-09-17T11:07:53.290907+0000 mgr.x (mgr.14263) 81 : cluster [DBG] pgmap v64: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T11:07:55.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:54 smithi066 bash[19869]: cluster 2024-09-17T11:07:53.290907+0000 mgr.x (mgr.14263) 81 : cluster [DBG] pgmap v64: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T11:07:55.547 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:07:56.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:56 smithi066 bash[19869]: cluster 2024-09-17T11:07:55.292094+0000 mgr.x (mgr.14263) 82 : cluster [DBG] pgmap v65: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 511 B/s rd, 426 B/s wr, 0 op/s 2024-09-17T11:07:56.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:56 smithi066 bash[19869]: cluster 2024-09-17T11:07:55.292094+0000 mgr.x (mgr.14263) 82 : cluster [DBG] pgmap v65: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 511 B/s rd, 426 B/s wr, 0 op/s 2024-09-17T11:07:57.160 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-17T11:07:57.160 INFO:teuthology.orchestra.run.smithi066.stdout: "resource": { 2024-09-17T11:07:57.161 INFO:teuthology.orchestra.run.smithi066.stdout: "resource_type": "ceph.smb.share", 2024-09-17T11:07:57.161 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_id": "modusr1", 2024-09-17T11:07:57.161 INFO:teuthology.orchestra.run.smithi066.stdout: "share_id": "share2", 2024-09-17T11:07:57.161 INFO:teuthology.orchestra.run.smithi066.stdout: "intent": "removed" 2024-09-17T11:07:57.161 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-17T11:07:57.161 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "removed", 2024-09-17T11:07:57.161 INFO:teuthology.orchestra.run.smithi066.stdout: "success": true 2024-09-17T11:07:57.161 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-17T11:07:57.860 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- bash -c 'ceph smb share rm modusr1 share1' 2024-09-17T11:07:58.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:56.996627+0000 mon.a (mon.0) 447 : audit [DBG] from='client.? 172.17.0.2:0/2756200207' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:58.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:56.996627+0000 mon.a (mon.0) 447 : audit [DBG] from='client.? 172.17.0.2:0/2756200207' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:07:58.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.122536+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:58.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.122536+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:58.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.124204+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "smb"} : dispatch 2024-09-17T11:07:58.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.124204+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "smb"} : dispatch 2024-09-17T11:07:58.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.137504+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key dump", "key": "smb/config/"} : dispatch 2024-09-17T11:07:58.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.137504+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key dump", "key": "smb/config/"} : dispatch 2024-09-17T11:07:58.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.138946+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.smb.fs.cluster.modusr1", "caps": ["/", "rw"]} : dispatch 2024-09-17T11:07:58.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.138946+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.smb.fs.cluster.modusr1", "caps": ["/", "rw"]} : dispatch 2024-09-17T11:07:58.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.154122+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:58.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.154122+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:58.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.155652+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:07:58.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.155652+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:07:58.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.159601+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:07:58.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.159601+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:07:58.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.161066+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:07:58.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.161066+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:07:58.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.167138+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:58.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.167138+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:58.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.174942+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:58.210 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:57 smithi066 bash[19869]: audit 2024-09-17T11:07:57.174942+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:07:59.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:58 smithi066 bash[19869]: audit 2024-09-17T11:07:57.076531+0000 mgr.x (mgr.14263) 83 : audit [DBG] from='client.14377 -' entity='client.admin' cmd=[{"prefix": "smb share rm", "cluster_id": "modusr1", "share_id": "share2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:07:59.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:58 smithi066 bash[19869]: audit 2024-09-17T11:07:57.076531+0000 mgr.x (mgr.14263) 83 : audit [DBG] from='client.14377 -' entity='client.admin' cmd=[{"prefix": "smb share rm", "cluster_id": "modusr1", "share_id": "share2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:07:59.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:58 smithi066 bash[19869]: audit 2024-09-17T11:07:57.126684+0000 mgr.x (mgr.14263) 84 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "smb"}]: dispatch 2024-09-17T11:07:59.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:58 smithi066 bash[19869]: audit 2024-09-17T11:07:57.126684+0000 mgr.x (mgr.14263) 84 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "group_name": "smb"}]: dispatch 2024-09-17T11:07:59.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:58 smithi066 bash[19869]: cephadm 2024-09-17T11:07:57.148813+0000 mgr.x (mgr.14263) 85 : cephadm [INF] Saving service smb.modusr1 spec with placement count:1 2024-09-17T11:07:59.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:58 smithi066 bash[19869]: cephadm 2024-09-17T11:07:57.148813+0000 mgr.x (mgr.14263) 85 : cephadm [INF] Saving service smb.modusr1 spec with placement count:1 2024-09-17T11:07:59.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:58 smithi066 bash[19869]: cluster 2024-09-17T11:07:57.292695+0000 mgr.x (mgr.14263) 86 : cluster [DBG] pgmap v66: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 426 B/s wr, 0 op/s 2024-09-17T11:07:59.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:07:58 smithi066 bash[19869]: cluster 2024-09-17T11:07:57.292695+0000 mgr.x (mgr.14263) 86 : cluster [DBG] pgmap v66: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 341 B/s rd, 426 B/s wr, 0 op/s 2024-09-17T11:08:01.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:00 smithi066 bash[19869]: cluster 2024-09-17T11:07:59.293704+0000 mgr.x (mgr.14263) 87 : cluster [DBG] pgmap v67: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.1 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:08:01.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:00 smithi066 bash[19869]: cluster 2024-09-17T11:07:59.293704+0000 mgr.x (mgr.14263) 87 : cluster [DBG] pgmap v67: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.1 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:08:02.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:01 smithi066 bash[19869]: cluster 2024-09-17T11:08:00.901097+0000 mon.a (mon.0) 458 : cluster [DBG] mgrmap e24: x(active, since 2m) 2024-09-17T11:08:02.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:01 smithi066 bash[19869]: cluster 2024-09-17T11:08:00.901097+0000 mon.a (mon.0) 458 : cluster [DBG] mgrmap e24: x(active, since 2m) 2024-09-17T11:08:02.657 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:08:03.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:02 smithi066 bash[19869]: cluster 2024-09-17T11:08:01.294331+0000 mgr.x (mgr.14263) 88 : cluster [DBG] pgmap v68: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.9 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:08:03.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:03 smithi066 bash[19869]: cluster 2024-09-17T11:08:01.294331+0000 mgr.x (mgr.14263) 88 : cluster [DBG] pgmap v68: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.9 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:08:03.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:03 smithi066 bash[19869]: audit 2024-09-17T11:08:02.032538+0000 mon.a (mon.0) 459 : audit [DBG] from='client.? 172.17.0.2:0/2354473496' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:08:03.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:03 smithi066 bash[19869]: audit 2024-09-17T11:08:02.032538+0000 mon.a (mon.0) 459 : audit [DBG] from='client.? 172.17.0.2:0/2354473496' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:08:04.425 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-17T11:08:04.425 INFO:teuthology.orchestra.run.smithi066.stdout: "resource": { 2024-09-17T11:08:04.425 INFO:teuthology.orchestra.run.smithi066.stdout: "resource_type": "ceph.smb.share", 2024-09-17T11:08:04.426 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_id": "modusr1", 2024-09-17T11:08:04.426 INFO:teuthology.orchestra.run.smithi066.stdout: "share_id": "share1", 2024-09-17T11:08:04.426 INFO:teuthology.orchestra.run.smithi066.stdout: "intent": "removed" 2024-09-17T11:08:04.426 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-17T11:08:04.426 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "removed", 2024-09-17T11:08:04.426 INFO:teuthology.orchestra.run.smithi066.stdout: "success": true 2024-09-17T11:08:04.426 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-17T11:08:05.070 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- bash -c 'ceph smb cluster rm modusr1' 2024-09-17T11:08:05.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: cluster 2024-09-17T11:08:03.294929+0000 mgr.x (mgr.14263) 89 : cluster [DBG] pgmap v69: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.9 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:08:05.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: cluster 2024-09-17T11:08:03.294929+0000 mgr.x (mgr.14263) 89 : cluster [DBG] pgmap v69: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.9 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:08:05.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.408606+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:08:05.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.408606+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:08:05.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.411331+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key dump", "key": "smb/config/"} : dispatch 2024-09-17T11:08:05.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.411331+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key dump", "key": "smb/config/"} : dispatch 2024-09-17T11:08:05.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.420635+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:08:05.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.420635+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:08:05.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.421842+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:08:05.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.421842+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:08:05.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.424729+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:08:05.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.424729+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:08:05.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.426023+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:08:05.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.426023+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:08:05.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.433855+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:08:05.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.433855+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:08:05.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.443432+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:08:05.209 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:04 smithi066 bash[19869]: audit 2024-09-17T11:08:04.443432+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:08:06.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:05 smithi066 bash[19869]: audit 2024-09-17T11:08:04.373711+0000 mgr.x (mgr.14263) 90 : audit [DBG] from='client.14387 -' entity='client.admin' cmd=[{"prefix": "smb share rm", "cluster_id": "modusr1", "share_id": "share1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:08:06.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:05 smithi066 bash[19869]: audit 2024-09-17T11:08:04.373711+0000 mgr.x (mgr.14263) 90 : audit [DBG] from='client.14387 -' entity='client.admin' cmd=[{"prefix": "smb share rm", "cluster_id": "modusr1", "share_id": "share1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:08:06.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:05 smithi066 bash[19869]: cephadm 2024-09-17T11:08:04.416308+0000 mgr.x (mgr.14263) 91 : cephadm [INF] Saving service smb.modusr1 spec with placement count:1 2024-09-17T11:08:06.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:05 smithi066 bash[19869]: cephadm 2024-09-17T11:08:04.416308+0000 mgr.x (mgr.14263) 91 : cephadm [INF] Saving service smb.modusr1 spec with placement count:1 2024-09-17T11:08:07.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:06 smithi066 bash[19869]: cluster 2024-09-17T11:08:05.295784+0000 mgr.x (mgr.14263) 92 : cluster [DBG] pgmap v70: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.0 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:08:07.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:06 smithi066 bash[19869]: cluster 2024-09-17T11:08:05.295784+0000 mgr.x (mgr.14263) 92 : cluster [DBG] pgmap v70: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 2.0 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-09-17T11:08:08.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:07 smithi066 bash[19869]: audit 2024-09-17T11:08:07.152288+0000 mon.a (mon.0) 468 : audit [DBG] from='client.? 172.17.0.2:0/3836606524' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:08:08.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:07 smithi066 bash[19869]: audit 2024-09-17T11:08:07.152288+0000 mon.a (mon.0) 468 : audit [DBG] from='client.? 172.17.0.2:0/3836606524' entity='client.smb.config.modusr1.smithi066.fdcjhb' cmd={"prefix": "config-key get", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:08:09.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:08 smithi066 bash[19869]: cluster 2024-09-17T11:08:07.296299+0000 mgr.x (mgr.14263) 93 : cluster [DBG] pgmap v71: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.8 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-17T11:08:09.230 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:08 smithi066 bash[19869]: cluster 2024-09-17T11:08:07.296299+0000 mgr.x (mgr.14263) 93 : cluster [DBG] pgmap v71: 97 pgs: 97 active+clean; 1.6 MiB data, 61 MiB used, 179 GiB / 179 GiB avail; 1.8 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-17T11:08:09.869 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:08:11.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:10 smithi066 bash[19869]: cluster 2024-09-17T11:08:09.297299+0000 mgr.x (mgr.14263) 94 : cluster [DBG] pgmap v72: 97 pgs: 97 active+clean; 1.6 MiB data, 65 MiB used, 179 GiB / 179 GiB avail; 3.5 KiB/s rd, 88 KiB/s wr, 9 op/s 2024-09-17T11:08:11.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:10 smithi066 bash[19869]: cluster 2024-09-17T11:08:09.297299+0000 mgr.x (mgr.14263) 94 : cluster [DBG] pgmap v72: 97 pgs: 97 active+clean; 1.6 MiB data, 65 MiB used, 179 GiB / 179 GiB avail; 3.5 KiB/s rd, 88 KiB/s wr, 9 op/s 2024-09-17T11:08:11.558 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-17T11:08:11.559 INFO:teuthology.orchestra.run.smithi066.stdout: "resource": { 2024-09-17T11:08:11.559 INFO:teuthology.orchestra.run.smithi066.stdout: "resource_type": "ceph.smb.cluster", 2024-09-17T11:08:11.559 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_id": "modusr1", 2024-09-17T11:08:11.559 INFO:teuthology.orchestra.run.smithi066.stdout: "intent": "removed" 2024-09-17T11:08:11.559 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-17T11:08:11.559 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "removed", 2024-09-17T11:08:11.559 INFO:teuthology.orchestra.run.smithi066.stdout: "success": true 2024-09-17T11:08:11.559 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-17T11:08:12.222 INFO:teuthology.run_tasks:Running task cephadm.wait_for_service_not_present... 2024-09-17T11:08:12.233 INFO:tasks.cephadm:Waiting for ceph service smb.modusr1 to be not present in service list 2024-09-17T11:08:12.234 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7498493279982dfe87f00616198a5967475f6169 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b966aac8-74e3-11ef-bceb-c7b262605968 -- ceph orch ls -f json 2024-09-17T11:08:12.858 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: cluster 2024-09-17T11:08:11.297875+0000 mgr.x (mgr.14263) 95 : cluster [DBG] pgmap v73: 97 pgs: 97 active+clean; 1.6 MiB data, 65 MiB used, 179 GiB / 179 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-17T11:08:12.859 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: cluster 2024-09-17T11:08:11.297875+0000 mgr.x (mgr.14263) 95 : cluster [DBG] pgmap v73: 97 pgs: 97 active+clean; 1.6 MiB data, 65 MiB used, 179 GiB / 179 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-17T11:08:12.859 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.471739+0000 mgr.x (mgr.14263) 96 : audit [DBG] from='client.14393 -' entity='client.admin' cmd=[{"prefix": "smb cluster rm", "cluster_id": "modusr1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:08:12.859 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.471739+0000 mgr.x (mgr.14263) 96 : audit [DBG] from='client.14393 -' entity='client.admin' cmd=[{"prefix": "smb cluster rm", "cluster_id": "modusr1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T11:08:12.859 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: cephadm 2024-09-17T11:08:11.517345+0000 mgr.x (mgr.14263) 97 : cephadm [INF] Remove service smb.modusr1 2024-09-17T11:08:12.859 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: cephadm 2024-09-17T11:08:11.517345+0000 mgr.x (mgr.14263) 97 : cephadm [INF] Remove service smb.modusr1 2024-09-17T11:08:12.859 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.521260+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:08:12.859 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.521260+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:08:12.859 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.522607+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key dump", "key": "smb/config/"} : dispatch 2024-09-17T11:08:12.859 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.522607+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key dump", "key": "smb/config/"} : dispatch 2024-09-17T11:08:12.859 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.523092+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:08:12.859 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.523092+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:08:12.859 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.524429+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key exists", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:08:12.860 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.524429+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key exists", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:08:12.860 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.525526+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key rm", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:08:12.860 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.525526+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key rm", "key": "smb/config/modusr1/users-groups.0.json"} : dispatch 2024-09-17T11:08:12.860 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.527949+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd='[{"prefix": "config-key rm", "key": "smb/config/modusr1/users-groups.0.json"}]': finished 2024-09-17T11:08:12.860 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.527949+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd='[{"prefix": "config-key rm", "key": "smb/config/modusr1/users-groups.0.json"}]': finished 2024-09-17T11:08:12.860 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.529097+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key dump", "key": "smb/config/"} : dispatch 2024-09-17T11:08:12.860 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:11.529097+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config-key dump", "key": "smb/config/"} : dispatch 2024-09-17T11:08:12.860 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:12.188771+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:08:12.860 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:12.188771+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T11:08:12.860 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:12.190515+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:08:12.860 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:12.190515+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T11:08:12.860 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:12.200244+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:08:12.861 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:12 smithi066 bash[19869]: audit 2024-09-17T11:08:12.200244+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' 2024-09-17T11:08:13.607 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:13 smithi066 bash[19869]: cephadm 2024-09-17T11:08:12.214116+0000 mgr.x (mgr.14263) 98 : cephadm [INF] Removing orphan daemon smb.modusr1.smithi066.fdcjhb... 2024-09-17T11:08:13.607 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:13 smithi066 bash[19869]: cephadm 2024-09-17T11:08:12.214116+0000 mgr.x (mgr.14263) 98 : cephadm [INF] Removing orphan daemon smb.modusr1.smithi066.fdcjhb... 2024-09-17T11:08:13.607 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:13 smithi066 bash[19869]: cephadm 2024-09-17T11:08:12.214327+0000 mgr.x (mgr.14263) 99 : cephadm [INF] Removing daemon smb.modusr1.smithi066.fdcjhb from smithi066 -- ports [445, 9922] 2024-09-17T11:08:13.607 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:13 smithi066 bash[19869]: cephadm 2024-09-17T11:08:12.214327+0000 mgr.x (mgr.14263) 99 : cephadm [INF] Removing daemon smb.modusr1.smithi066.fdcjhb from smithi066 -- ports [445, 9922] 2024-09-17T11:08:14.416 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:08:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:14.417 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:08:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:14.417 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:08:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:14.417 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:14.672 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:08:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:14.672 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:08:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:14.673 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:14 smithi066 bash[19869]: cluster 2024-09-17T11:08:13.298257+0000 mgr.x (mgr.14263) 100 : cluster [DBG] pgmap v74: 97 pgs: 97 active+clean; 1.6 MiB data, 65 MiB used, 179 GiB / 179 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-17T11:08:14.673 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:14 smithi066 bash[19869]: cluster 2024-09-17T11:08:13.298257+0000 mgr.x (mgr.14263) 100 : cluster [DBG] pgmap v74: 97 pgs: 97 active+clean; 1.6 MiB data, 65 MiB used, 179 GiB / 179 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-17T11:08:14.673 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:14.673 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:08:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:14.931 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:08:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:14.932 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:08:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:14.932 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:08:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:14.932 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:14 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:15.207 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:08:15 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:15.208 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:08:15 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:15.208 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:08:15 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:15.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:15 smithi066 systemd[1]: /etc/systemd/system/ceph-b966aac8-74e3-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-17T11:08:15.785 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:15 smithi066 bash[19869]: audit 2024-09-17T11:08:15.236305+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.smb.config.modusr1.smithi066.fdcjhb"} : dispatch 2024-09-17T11:08:15.785 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:15 smithi066 bash[19869]: audit 2024-09-17T11:08:15.236305+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "auth rm", "entity": "client.smb.config.modusr1.smithi066.fdcjhb"} : dispatch 2024-09-17T11:08:15.785 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:15 smithi066 bash[19869]: audit 2024-09-17T11:08:15.237925+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd='[{"prefix": "auth rm", "entity": "client.smb.config.modusr1.smithi066.fdcjhb"}]': finished 2024-09-17T11:08:15.786 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:15 smithi066 bash[19869]: audit 2024-09-17T11:08:15.237925+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd='[{"prefix": "auth rm", "entity": "client.smb.config.modusr1.smithi066.fdcjhb"}]': finished 2024-09-17T11:08:15.786 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:15 smithi066 bash[19869]: audit 2024-09-17T11:08:15.242228+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix":"config-key del","key":"mgr/cephadm/spec.smb.modusr1"} : dispatch 2024-09-17T11:08:15.786 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:15 smithi066 bash[19869]: audit 2024-09-17T11:08:15.242228+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix":"config-key del","key":"mgr/cephadm/spec.smb.modusr1"} : dispatch 2024-09-17T11:08:15.786 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:15 smithi066 bash[19869]: audit 2024-09-17T11:08:15.245654+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/spec.smb.modusr1"}]': finished 2024-09-17T11:08:15.786 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:15 smithi066 bash[19869]: audit 2024-09-17T11:08:15.245654+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/spec.smb.modusr1"}]': finished 2024-09-17T11:08:15.786 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:15 smithi066 bash[19869]: audit 2024-09-17T11:08:15.247041+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:08:15.786 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:15 smithi066 bash[19869]: audit 2024-09-17T11:08:15.247041+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14263 172.21.15.66:0/3354477730' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T11:08:16.957 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:16 smithi066 bash[19869]: cephadm 2024-09-17T11:08:15.235834+0000 mgr.x (mgr.14263) 101 : cephadm [INF] Removing key for client.smb.config.modusr1.smithi066.fdcjhb 2024-09-17T11:08:16.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:16 smithi066 bash[19869]: cephadm 2024-09-17T11:08:15.235834+0000 mgr.x (mgr.14263) 101 : cephadm [INF] Removing key for client.smb.config.modusr1.smithi066.fdcjhb 2024-09-17T11:08:16.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:16 smithi066 bash[19869]: cephadm 2024-09-17T11:08:15.241870+0000 mgr.x (mgr.14263) 102 : cephadm [INF] Purge service smb.modusr1 2024-09-17T11:08:16.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:16 smithi066 bash[19869]: cephadm 2024-09-17T11:08:15.241870+0000 mgr.x (mgr.14263) 102 : cephadm [INF] Purge service smb.modusr1 2024-09-17T11:08:16.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:16 smithi066 bash[19869]: cluster 2024-09-17T11:08:15.298884+0000 mgr.x (mgr.14263) 103 : cluster [DBG] pgmap v75: 97 pgs: 97 active+clean; 1.6 MiB data, 65 MiB used, 179 GiB / 179 GiB avail; 4.0 KiB/s rd, 98 KiB/s wr, 10 op/s 2024-09-17T11:08:16.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:16 smithi066 bash[19869]: cluster 2024-09-17T11:08:15.298884+0000 mgr.x (mgr.14263) 103 : cluster [DBG] pgmap v75: 97 pgs: 97 active+clean; 1.6 MiB data, 65 MiB used, 179 GiB / 179 GiB avail; 4.0 KiB/s rd, 98 KiB/s wr, 10 op/s 2024-09-17T11:08:17.674 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T11:08:18.790 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:18 smithi066 bash[19869]: cluster 2024-09-17T11:08:17.299475+0000 mgr.x (mgr.14263) 104 : cluster [DBG] pgmap v76: 97 pgs: 97 active+clean; 1.6 MiB data, 65 MiB used, 179 GiB / 179 GiB avail; 3.9 KiB/s rd, 98 KiB/s wr, 10 op/s 2024-09-17T11:08:18.790 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:18 smithi066 bash[19869]: cluster 2024-09-17T11:08:17.299475+0000 mgr.x (mgr.14263) 104 : cluster [DBG] pgmap v76: 97 pgs: 97 active+clean; 1.6 MiB data, 65 MiB used, 179 GiB / 179 GiB avail; 3.9 KiB/s rd, 98 KiB/s wr, 10 op/s 2024-09-17T11:08:19.162 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-17T11:08:19.162 INFO:teuthology.orchestra.run.smithi066.stdout:[{"placement": {"count": 2}, "service_id": "cephfs", "service_name": "mds.cephfs", "service_type": "mds", "status": {"created": "2024-09-17T11:05:06.330020Z", "last_refresh": "2024-09-17T11:07:09.751662Z", "running": 2, "size": 2}}, {"placement": {"count": 1, "hosts": ["smithi066=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2024-09-17T11:01:36.809564Z", "last_refresh": "2024-09-17T11:07:09.751339Z", "running": 1, "size": 1}}, {"placement": {"count": 1, "hosts": ["smithi066:172.21.15.66=a"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2024-09-17T11:01:16.208618Z", "last_refresh": "2024-09-17T11:07:09.751211Z", "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "6c1fcab85602ba9d6ddde3c89adee6ee0382b7527a8ed3ee372c969068775c76", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d1ee255599fffe6c832aeedeed0b06c298863896564017e014e180f38b9ae1bb", "last_refresh": "2024-09-17T11:07:09.751448Z", "running": 2, "size": 2}, "unmanaged": true}] 2024-09-17T11:08:19.815 DEBUG:tasks.cephadm:checking if 'smb.modusr1' in {'mon', 'mds.cephfs', 'osd', 'mgr'} 2024-09-17T11:08:19.815 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-17T11:08:19.825 INFO:tasks.cephadm:Teardown begin 2024-09-17T11:08:19.826 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T11:08:19.840 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T11:08:19.855 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-17T11:08:19.855 DEBUG:teuthology.orchestra.run.smithi066:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T11:08:19.894 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T11:08:19.903 INFO:tasks.cephadm:Stopping all daemons... 2024-09-17T11:08:19.903 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-17T11:08:19.903 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mon.a 2024-09-17T11:08:20.075 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:19 smithi066 systemd[1]: Stopping Ceph mon.a for b966aac8-74e3-11ef-bceb-c7b262605968... 2024-09-17T11:08:20.207 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:20 smithi066 bash[19869]: debug 2024-09-17T11:08:20.071+0000 7ff0c203b640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-17T11:08:20.208 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 17 11:08:20 smithi066 bash[19869]: debug 2024-09-17T11:08:20.071+0000 7ff0c203b640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-17T11:08:21.007 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mon.a.service' 2024-09-17T11:08:21.038 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T11:08:21.038 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-17T11:08:21.038 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-17T11:08:21.038 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mgr.x 2024-09-17T11:08:21.262 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:08:21 smithi066 systemd[1]: Stopping Ceph mgr.x for b966aac8-74e3-11ef-bceb-c7b262605968... 2024-09-17T11:08:21.262 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:08:21 smithi066 bash[20129]: debug 2024-09-17T11:08:21.199+0000 7f4244a71640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-17T11:08:21.262 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 17 11:08:21 smithi066 bash[20129]: debug 2024-09-17T11:08:21.199+0000 7f4244a71640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-17T11:08:21.942 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b966aac8-74e3-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-17T11:08:21.965 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T11:08:21.965 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-17T11:08:21.965 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-17T11:08:21.965 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-b966aac8-74e3-11ef-bceb-c7b262605968@osd.0 2024-09-17T11:08:22.208 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:08:22 smithi066 systemd[1]: Stopping Ceph osd.0 for b966aac8-74e3-11ef-bceb-c7b262605968... 2024-09-17T11:08:22.208 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:08:22 smithi066 bash[29451]: debug 2024-09-17T11:08:22.143+0000 7f50bc366640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-17T11:08:22.208 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:08:22 smithi066 bash[29451]: debug 2024-09-17T11:08:22.143+0000 7f50bc366640 -1 osd.0 26 *** Got signal Terminated *** 2024-09-17T11:08:22.208 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:08:22 smithi066 bash[29451]: debug 2024-09-17T11:08:22.143+0000 7f50bc366640 -1 osd.0 26 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T11:08:28.327 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:08:28 smithi066 bash[45951]: ceph-b966aac8-74e3-11ef-bceb-c7b262605968-osd-0 2024-09-17T11:08:28.327 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 17 11:08:28 smithi066 bash[46013]: Error response from daemon: No such container: ceph-b966aac8-74e3-11ef-bceb-c7b262605968-osd-0 2024-09-17T11:08:30.094 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b966aac8-74e3-11ef-bceb-c7b262605968@osd.0.service' 2024-09-17T11:08:30.122 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T11:08:30.122 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-17T11:08:30.122 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-17T11:08:30.123 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-b966aac8-74e3-11ef-bceb-c7b262605968@osd.1 2024-09-17T11:08:30.458 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:08:30 smithi066 systemd[1]: Stopping Ceph osd.1 for b966aac8-74e3-11ef-bceb-c7b262605968... 2024-09-17T11:08:30.458 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:08:30 smithi066 bash[35017]: debug 2024-09-17T11:08:30.279+0000 7f9436687640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-17T11:08:30.458 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:08:30 smithi066 bash[35017]: debug 2024-09-17T11:08:30.279+0000 7f9436687640 -1 osd.1 26 *** Got signal Terminated *** 2024-09-17T11:08:30.458 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:08:30 smithi066 bash[35017]: debug 2024-09-17T11:08:30.279+0000 7f9436687640 -1 osd.1 26 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T11:08:36.613 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:08:36 smithi066 bash[46144]: ceph-b966aac8-74e3-11ef-bceb-c7b262605968-osd-1 2024-09-17T11:08:36.613 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 17 11:08:36 smithi066 bash[46206]: Error response from daemon: No such container: ceph-b966aac8-74e3-11ef-bceb-c7b262605968-osd-1 2024-09-17T11:08:38.430 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b966aac8-74e3-11ef-bceb-c7b262605968@osd.1.service' 2024-09-17T11:08:38.470 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T11:08:38.470 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-17T11:08:38.471 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b966aac8-74e3-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T11:08:38.697 INFO:teuthology.orchestra.run.smithi066.stdout:Deleting cluster with fsid: b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T11:08:59.917 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b966aac8-74e3-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T11:09:00.100 INFO:teuthology.orchestra.run.smithi161.stdout:Deleting cluster with fsid: b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T11:09:01.230 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T11:09:01.245 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T11:09:01.257 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-17T11:09:01.259 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_20:08:15-orch-main-distro-default-smithi/7907709/remote/smithi066/crash 2024-09-17T11:09:01.260 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/crash -- . 2024-09-17T11:09:01.304 INFO:teuthology.orchestra.run.smithi066.stderr:tar: /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T11:09:01.304 INFO:teuthology.orchestra.run.smithi066.stderr:tar: Error is not recoverable: exiting now 2024-09-17T11:09:01.306 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_20:08:15-orch-main-distro-default-smithi/7907709/remote/smithi161/crash 2024-09-17T11:09:01.307 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/crash -- . 2024-09-17T11:09:01.318 INFO:teuthology.orchestra.run.smithi161.stderr:tar: /var/lib/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T11:09:01.318 INFO:teuthology.orchestra.run.smithi161.stderr:tar: Error is not recoverable: exiting now 2024-09-17T11:09:01.320 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-17T11:09:01.320 DEBUG:teuthology.orchestra.run.smithi066:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-09-17T11:09:01.363 INFO:tasks.cephadm:Compressing logs... 2024-09-17T11:09:01.363 DEBUG:teuthology.orchestra.run.smithi066:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T11:09:01.410 DEBUG:teuthology.orchestra.run.smithi161:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T11:09:01.420 INFO:teuthology.orchestra.run.smithi066.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-09-17T11:09:01.423 INFO:teuthology.orchestra.run.smithi161.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-09-17T11:09:01.427 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-17T11:09:01.428 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/cephadm.log: 76.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-17T11:09:01.429 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-09-17T11:09:01.429 INFO:teuthology.orchestra.run.smithi161.stderr:real 0m0.015s 2024-09-17T11:09:01.429 INFO:teuthology.orchestra.run.smithi161.stderr:user 0m0.010s 2024-09-17T11:09:01.430 INFO:teuthology.orchestra.run.smithi161.stderr:sys 0m0.010s 2024-09-17T11:09:01.443 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-17T11:09:01.443 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-17T11:09:01.444 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-17T11:09:01.444 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-17T11:09:01.446 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-17T11:09:01.446 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-17T11:09:01.446 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph.cephadm.log: /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph.log 2024-09-17T11:09:01.447 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-mgr.x.log: 81.5% -- replaced with /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-17T11:09:01.448 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-17T11:09:01.448 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi066.lwdicv.log 2024-09-17T11:09:01.448 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-17T11:09:01.449 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi066.lwdicv.log: 86.7% -- replaced with /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-17T11:09:01.449 INFO:teuthology.orchestra.run.smithi066.stderr: 78.9% -- replaced with /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi066.lwdicv.log.gz 2024-09-17T11:09:01.450 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- 88.5% /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi066.fjggnr.log 2024-09-17T11:09:01.450 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-17T11:09:01.451 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi066.fjggnr.log: 88.9% -- replaced with /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-17T11:09:01.452 INFO:teuthology.orchestra.run.smithi066.stderr: 86.4% -- replaced with /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi066.fjggnr.log.gz 2024-09-17T11:09:01.455 INFO:teuthology.orchestra.run.smithi066.stderr: 91.4% -- replaced with /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-17T11:09:01.551 INFO:teuthology.orchestra.run.smithi066.stderr: 89.5% -- replaced with /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-17T11:09:01.612 INFO:teuthology.orchestra.run.smithi066.stderr: 90.9% -- replaced with /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-17T11:09:01.742 INFO:teuthology.orchestra.run.smithi066.stderr: 94.7% -- replaced with /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-17T11:09:01.762 INFO:teuthology.orchestra.run.smithi066.stderr: 94.6% -- replaced with /var/log/ceph/b966aac8-74e3-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-17T11:09:01.763 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-09-17T11:09:01.764 INFO:teuthology.orchestra.run.smithi066.stderr:real 0m0.351s 2024-09-17T11:09:01.764 INFO:teuthology.orchestra.run.smithi066.stderr:user 0m0.897s 2024-09-17T11:09:01.764 INFO:teuthology.orchestra.run.smithi066.stderr:sys 0m0.039s 2024-09-17T11:09:01.765 INFO:tasks.cephadm:Archiving logs... 2024-09-17T11:09:01.765 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_20:08:15-orch-main-distro-default-smithi/7907709/remote/smithi066/log 2024-09-17T11:09:01.766 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T11:09:01.941 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_20:08:15-orch-main-distro-default-smithi/7907709/remote/smithi161/log 2024-09-17T11:09:01.942 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T11:09:01.957 INFO:tasks.cephadm:Removing cluster... 2024-09-17T11:09:01.957 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b966aac8-74e3-11ef-bceb-c7b262605968 --force 2024-09-17T11:09:02.140 INFO:teuthology.orchestra.run.smithi066.stdout:Deleting cluster with fsid: b966aac8-74e3-11ef-bceb-c7b262605968 2024-09-17T11:09:03.268 INFO:tasks.cephadm:Removing cephadm ... 2024-09-17T11:09:03.268 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T11:09:03.273 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T11:09:03.279 INFO:tasks.cephadm:Teardown complete 2024-09-17T11:09:03.279 DEBUG:teuthology.run_tasks:Unwinding manager cephadm.configure_samba_client_container 2024-09-17T11:09:03.295 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T11:09:03.358 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T11:09:03.359 DEBUG:teuthology.orchestra.run.smithi066:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T11:09:03.361 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T11:09:03.370 INFO:teuthology.orchestra.run.smithi066.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T11:09:03.370 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================== 2024-09-17T11:09:03.370 INFO:teuthology.orchestra.run.smithi066.stdout:*hv01.front.sepi 67.205.162.81 3 u 65 64 377 0.082 +1.499 0.749 2024-09-17T11:09:03.371 INFO:teuthology.orchestra.run.smithi066.stdout:+hv02.front.sepi 96.245.170.99 3 u 12 64 377 0.092 -0.017 0.436 2024-09-17T11:09:03.371 INFO:teuthology.orchestra.run.smithi066.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.068 +0.823 0.514 2024-09-17T11:09:03.371 INFO:teuthology.orchestra.run.smithi066.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-09-17T11:09:03.374 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T11:09:03.374 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2024-09-17T11:09:03.374 INFO:teuthology.orchestra.run.smithi161.stdout:+hv01.front.sepi 67.205.162.81 3 u 6 64 377 0.067 -0.386 0.771 2024-09-17T11:09:03.374 INFO:teuthology.orchestra.run.smithi161.stdout:+hv02.front.sepi 96.245.170.99 3 u 10 64 377 0.102 -2.471 0.832 2024-09-17T11:09:03.374 INFO:teuthology.orchestra.run.smithi161.stdout:*hv03.front.sepi 74.6.168.72 3 u 8 64 377 0.110 -1.022 0.723 2024-09-17T11:09:03.374 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-09-17T11:09:03.375 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T11:09:03.457 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T11:09:03.459 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T11:09:03.492 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T11:09:03.502 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T11:09:03.511 INFO:teuthology.task.internal:Duration was 1127.571301 seconds 2024-09-17T11:09:03.512 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T11:09:03.521 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T11:09:03.521 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T11:09:03.523 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T11:09:03.561 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T11:09:03.561 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi066.front.sepia.ceph.com 2024-09-17T11:09:03.562 DEBUG:teuthology.orchestra.run.smithi066:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T11:09:03.615 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2024-09-17T11:09:03.615 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T11:09:03.626 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T11:09:03.626 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T11:09:03.658 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T11:09:03.698 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T11:09:03.698 DEBUG:teuthology.orchestra.run.smithi066:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T11:09:03.742 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T11:09:03.831 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T11:09:03.842 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T11:09:03.842 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T11:09:03.855 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T11:09:03.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T11:09:03.878 DEBUG:teuthology.orchestra.run.smithi066:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T11:09:03.901 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T11:09:03.907 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = core 2024-09-17T11:09:03.923 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2024-09-17T11:09:04.016 DEBUG:teuthology.orchestra.run.smithi066:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T11:09:04.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T11:09:04.022 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T11:09:04.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T11:09:04.062 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T11:09:04.075 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T11:09:04.076 DEBUG:teuthology.misc:Transferring archived files from smithi066:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_20:08:15-orch-main-distro-default-smithi/7907709/remote/smithi066 2024-09-17T11:09:04.076 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T11:09:04.100 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_20:08:15-orch-main-distro-default-smithi/7907709/remote/smithi161 2024-09-17T11:09:04.100 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T11:09:04.126 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T11:09:04.127 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T11:09:04.142 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T11:09:04.175 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T11:09:04.189 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T11:09:04.189 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T11:09:04.203 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T11:09:04.204 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T11:09:04.206 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T11:09:04.213 INFO:teuthology.orchestra.run.smithi066.stdout: 658636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 11:09 /home/ubuntu/cephtest 2024-09-17T11:09:04.224 INFO:teuthology.orchestra.run.smithi161.stdout: 658729 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 11:09 /home/ubuntu/cephtest 2024-09-17T11:09:04.225 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T11:09:04.241 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T11:09:04.359 INFO:teuthology.run:Summary data: description: orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_basic} duration: 1127.5713012218475 owner: scheduled_teuthology@teuthology success: true 2024-09-17T11:09:04.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T11:09:04.440 INFO:teuthology.run:pass