2023-04-11T16:03:59.176 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae
2023-04-11T16:03:59.177 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-04-11_14:23:50-orch-pacific-release-distro-default-smithi/7238536 --verbose --name yuriw-2023-04-11_14:23:50-orch-pacific-release-distro-default-smithi --description orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} -- /home/teuthworker/archive/yuriw-2023-04-11_14:23:50-orch-pacific-release-distro-default-smithi/7238536/orig.config.yaml
2023-04-11T16:03:59.204 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/
2023-04-11T16:03:59.281 INFO:teuthology.run:Config:
  archive_path: /home/teuthworker/archive/yuriw-2023-04-11_14:23:50-orch-pacific-release-distro-default-smithi/7238536
  branch: pacific-release
  description: orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
  email: null
  first_in_suite: false
  job_id: '7238536'
  kernel:
    kdb: true
    sha1: distro
  last_in_suite: false
  machine_type: smithi
  name: yuriw-2023-04-11_14:23:50-orch-pacific-release-distro-default-smithi
  no_nested_subset: false
  nuke-on-error: true
  openstack:
  - volumes:
      count: 4
      size: 10
  os_type: ubuntu
  os_version: '18.04'
  overrides:
    admin_socket:
      branch: pacific-release
    ceph:
      conf:
        mgr:
          debug mgr: 20
          debug ms: 1
        mon:
          debug mon: 20
          debug ms: 1
          debug paxos: 20
        osd:
          debug ms: 1
          debug osd: 20
          osd shutdown pgref assert: true
      flavor: default
      log-ignorelist:
      - \(MDS_ALL_DOWN\)
      - \(MDS_UP_LESS_THAN_MAX\)
      sha1: 7170c9b95054b834ac0ed4c3453ebc92157b37e3
    ceph-deploy:
      conf:
        client:
          log file: /var/log/ceph/ceph-$name.$pid.log
        mon:
          osd default pool size: 2
    install:
      ceph:
        flavor: default
        sha1: 7170c9b95054b834ac0ed4c3453ebc92157b37e3
    workunit:
      branch: pacific-release
      sha1: 7170c9b95054b834ac0ed4c3453ebc92157b37e3
  owner: scheduled_yuriw@teuthology
  priority: 71
  repo: https://github.com/ceph/ceph-ci.git
  roles:
  - - host.a
    - client.0
  - - host.b
    - client.1
  seed: 6741
  sha1: 7170c9b95054b834ac0ed4c3453ebc92157b37e3
  sleep_before_teardown: 0
  subset: 111/12000
  suite: orch
  suite_branch: pacific-release
  suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_7170c9b95054b834ac0ed4c3453ebc92157b37e3/qa
  suite_relpath: qa
  suite_repo: https://github.com/ceph/ceph-ci.git
  suite_sha1: 7170c9b95054b834ac0ed4c3453ebc92157b37e3
  targets:
    smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHSAlWjESMc0Gra5f/6dvvbjuYJc2qVK13Ztw1gt4S0hdg9pLl/eAcLsaHQz3OAGEzcbKS0DF4bknjuwe5HHhPE=
    smithi187.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO1iFc3L7I+8QffZ61Yh05USfQhcDJhG14MCVPraId6H5t/3ncQ7JYnWTLUpdIgxX2uLa6KZHQeEX8siN4zMGCi28x2LIFrKdpeJS4yqa4imXazBSX8SNivVnZe+Grtd2V/dAHrGib95T67VW1a0p/k+6liUZyLFplFq9StkBkIpmwy424rNQRMCHnBRxb2hIKRs9YM36YlRjigLpoyeuptB7/EbLmtx3MxS+JOlLIN2DgjHAu5n7RRzawQlP7K6Iwe2eGPIVCTJsURg5/lJswzxYy7yzm+syJmY3YYQSNAMEunLrz4JDC2xMWWZmqpeBOP4QNSFSaYujTI0PBl1tN
  tasks:
  - nvme_loop: null
  - cephadm:
      roleless: true
  - cephadm.shell:
      host.a:
      - ceph orch status
      - ceph orch ps
      - ceph orch ls
      - ceph orch host ls
      - ceph orch device ls
      - ceph orch ls | grep '^osd.all-available-devices '
  - cephadm.shell:
      host.a:
      - 'set -e
  
        set -x
  
        ceph orch ps
  
        ceph orch device ls
  
        DEVID=$(ceph device ls | grep osd.1 | awk ''{print $1}'')
  
        HOST=$(ceph orch device ls | grep $DEVID | awk ''{print $1}'')
  
        DEV=$(ceph orch device ls | grep $DEVID | awk ''{print $2}'')
  
        echo "host $HOST, dev $DEV, devid $DEVID"
  
        ceph orch osd rm 1
  
        while ceph orch osd rm status | grep ^1 ; do sleep 5 ; done
  
        ceph orch device zap $HOST $DEV --force
  
        ceph orch daemon add osd $HOST:$DEV
  
        while ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done
  
        '
  teuthology:
    fragments_dropped: []
    meta: {}
    postmerge: []
  teuthology_branch: main
  teuthology_sha1: 8d156aede5efdae00b53d8d3b8d127082980e7ec
  timestamp: 2023-04-11_14:23:50
  tube: smithi
  user: yuriw
  verbose: true
  worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459
2023-04-11T16:03:59.281 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_7170c9b95054b834ac0ed4c3453ebc92157b37e3/qa; will attempt to use it
2023-04-11T16:03:59.282 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_7170c9b95054b834ac0ed4c3453ebc92157b37e3/qa/tasks
2023-04-11T16:03:59.283 INFO:teuthology.run_tasks:Running task internal.check_packages...
2023-04-11T16:03:59.284 INFO:teuthology.task.internal:Checking packages...
2023-04-11T16:03:59.316 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7170c9b95054b834ac0ed4c3453ebc92157b37e3'
2023-04-11T16:03:59.317 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch
2023-04-11T16:03:59.317 INFO:teuthology.packaging:ref: None
2023-04-11T16:03:59.317 INFO:teuthology.packaging:tag: None
2023-04-11T16:03:59.317 INFO:teuthology.packaging:branch: pacific-release
2023-04-11T16:03:59.318 INFO:teuthology.packaging:sha1: 7170c9b95054b834ac0ed4c3453ebc92157b37e3
2023-04-11T16:03:59.318 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=pacific-release
2023-04-11T16:03:59.476 INFO:teuthology.task.internal:Found packages for ceph version 16.2.11-391-g7170c9b9-1bionic
2023-04-11T16:03:59.477 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep...
2023-04-11T16:03:59.488 INFO:teuthology.task.internal:no buildpackages task found
2023-04-11T16:03:59.488 INFO:teuthology.run_tasks:Running task internal.save_config...
2023-04-11T16:03:59.503 INFO:teuthology.task.internal:Saving configuration
2023-04-11T16:03:59.513 INFO:teuthology.run_tasks:Running task internal.check_lock...
2023-04-11T16:03:59.521 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-04-11T16:03:59.549 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-04-11_14:23:50-orch-pacific-release-distro-default-smithi/7238536', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '18.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-04-11 15:58:37.656705', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII4U6ItCfOdoN1WdROC3KO40lcw/kzXeIM8M8q950kfL'}
2023-04-11T16:03:59.576 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-04-11_14:23:50-orch-pacific-release-distro-default-smithi/7238536', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '18.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-04-11 15:58:37.658264', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII4U6ItCfOdoN1WdROC3KO40lcw/kzXeIM8M8q950kfL'}
2023-04-11T16:03:59.576 INFO:teuthology.run_tasks:Running task internal.add_remotes...
2023-04-11T16:03:59.587 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['host.a', 'client.0']
2023-04-11T16:03:59.588 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['host.b', 'client.1']
2023-04-11T16:03:59.588 INFO:teuthology.run_tasks:Running task console_log...
2023-04-11T16:03:59.674 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f828e085520>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f828d06fdc0>, signals=[15])
2023-04-11T16:03:59.675 INFO:teuthology.run_tasks:Running task internal.connect...
2023-04-11T16:03:59.686 INFO:teuthology.task.internal:Opening connections...
2023-04-11T16:03:59.686 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com
2023-04-11T16:03:59.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-04-11T16:03:59.764 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com
2023-04-11T16:03:59.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-04-11T16:03:59.837 INFO:teuthology.run_tasks:Running task internal.push_inventory...
2023-04-11T16:03:59.847 DEBUG:teuthology.orchestra.run.smithi159:> uname -m
2023-04-11T16:03:59.876 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2023-04-11T16:03:59.877 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-04-11T16:03:59.923 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Ubuntu"
2023-04-11T16:03:59.924 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2023-04-11T16:03:59.924 INFO:teuthology.orchestra.run.smithi159.stdout:ID=ubuntu
2023-04-11T16:03:59.924 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE=debian
2023-04-11T16:03:59.924 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2023-04-11T16:03:59.924 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="18.04"
2023-04-11T16:03:59.925 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.ubuntu.com/"
2023-04-11T16:03:59.925 INFO:teuthology.orchestra.run.smithi159.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-04-11T16:03:59.925 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-04-11T16:03:59.925 INFO:teuthology.orchestra.run.smithi159.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-04-11T16:03:59.925 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_CODENAME=bionic
2023-04-11T16:03:59.925 INFO:teuthology.orchestra.run.smithi159.stdout:UBUNTU_CODENAME=bionic
2023-04-11T16:03:59.926 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-04-11T16:03:59.953 DEBUG:teuthology.orchestra.run.smithi187:> uname -m
2023-04-11T16:03:59.958 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64
2023-04-11T16:03:59.959 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release
2023-04-11T16:04:00.006 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu"
2023-04-11T16:04:00.006 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2023-04-11T16:04:00.006 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu
2023-04-11T16:04:00.006 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian
2023-04-11T16:04:00.006 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2023-04-11T16:04:00.006 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="18.04"
2023-04-11T16:04:00.007 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/"
2023-04-11T16:04:00.007 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-04-11T16:04:00.007 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-04-11T16:04:00.007 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-04-11T16:04:00.007 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=bionic
2023-04-11T16:04:00.007 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=bionic
2023-04-11T16:04:00.008 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2023-04-11T16:04:00.027 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles...
2023-04-11T16:04:00.039 INFO:teuthology.run_tasks:Running task internal.check_conflict...
2023-04-11T16:04:00.087 INFO:teuthology.task.internal:Checking for old test directory...
2023-04-11T16:04:00.088 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest
2023-04-11T16:04:00.090 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest
2023-04-11T16:04:00.095 INFO:teuthology.run_tasks:Running task internal.check_ceph_data...
2023-04-11T16:04:00.102 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph...
2023-04-11T16:04:00.102 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph)
2023-04-11T16:04:00.136 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph)
2023-04-11T16:04:00.153 INFO:teuthology.run_tasks:Running task internal.vm_setup...
2023-04-11T16:04:00.203 INFO:teuthology.run_tasks:Running task kernel...
2023-04-11T16:04:00.218 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'}
2023-04-11T16:04:00.219 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300
2023-04-11T16:04:00.220 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv
2023-04-11T16:04:00.220 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv
2023-04-11T16:04:00.225 DEBUG:teuthology.orchestra.run:got remote process result: 1
2023-04-11T16:04:00.226 DEBUG:teuthology.orchestra.run.smithi159:> uname -r
2023-04-11T16:04:00.226 DEBUG:teuthology.orchestra.run:got remote process result: 1
2023-04-11T16:04:00.227 DEBUG:teuthology.orchestra.run.smithi187:> uname -r
2023-04-11T16:04:00.272 INFO:teuthology.orchestra.run.smithi159.stdout:4.15.0-200-generic
2023-04-11T16:04:00.272 INFO:teuthology.task.kernel:Running kernel on smithi159: 4.15.0-200-generic
2023-04-11T16:04:00.272 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-get clean
2023-04-11T16:04:00.274 INFO:teuthology.orchestra.run.smithi187.stdout:4.15.0-200-generic
2023-04-11T16:04:00.274 INFO:teuthology.task.kernel:Running kernel on smithi187: 4.15.0-200-generic
2023-04-11T16:04:00.274 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get clean
2023-04-11T16:04:00.367 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update
2023-04-11T16:04:00.368 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-get update
2023-04-11T16:04:00.519 INFO:teuthology.orchestra.run.smithi159.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
2023-04-11T16:04:00.527 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease
2023-04-11T16:04:00.527 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
2023-04-11T16:04:00.527 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
2023-04-11T16:04:00.596 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [83.3 kB]
2023-04-11T16:04:00.649 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease
2023-04-11T16:04:00.730 INFO:teuthology.orchestra.run.smithi159.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
2023-04-11T16:04:00.764 INFO:teuthology.orchestra.run.smithi159.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [1,335 kB]
2023-04-11T16:04:00.855 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [1,335 kB]
2023-04-11T16:04:00.879 INFO:teuthology.orchestra.run.smithi159.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [2,612 kB]
2023-04-11T16:04:00.916 INFO:teuthology.orchestra.run.smithi159.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [452 kB]
2023-04-11T16:04:00.920 INFO:teuthology.orchestra.run.smithi159.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [1,169 kB]
2023-04-11T16:04:00.932 INFO:teuthology.orchestra.run.smithi159.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [31.8 kB]
2023-04-11T16:04:00.932 INFO:teuthology.orchestra.run.smithi159.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [162 kB]
2023-04-11T16:04:00.933 INFO:teuthology.orchestra.run.smithi159.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [1,069 kB]
2023-04-11T16:04:00.944 INFO:teuthology.orchestra.run.smithi159.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,284 kB]
2023-04-11T16:04:00.956 INFO:teuthology.orchestra.run.smithi159.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [302 kB]
2023-04-11T16:04:00.956 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [2,612 kB]
2023-04-11T16:04:00.958 INFO:teuthology.orchestra.run.smithi159.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [6,008 B]
2023-04-11T16:04:00.986 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [2,946 kB]
2023-04-11T16:04:00.993 INFO:teuthology.orchestra.run.smithi159.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.8 kB]
2023-04-11T16:04:00.993 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [452 kB]
2023-04-11T16:04:00.999 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [1,169 kB]
2023-04-11T16:04:01.012 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [31.8 kB]
2023-04-11T16:04:01.012 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [162 kB]
2023-04-11T16:04:01.014 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [1,069 kB]
2023-04-11T16:04:01.025 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,284 kB]
2023-04-11T16:04:01.035 INFO:teuthology.orchestra.run.smithi159.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [3,928 B]
2023-04-11T16:04:01.038 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [302 kB]
2023-04-11T16:04:01.041 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.8 kB]
2023-04-11T16:04:01.049 INFO:teuthology.orchestra.run.smithi159.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [83.3 kB]
2023-04-11T16:04:01.077 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [6,008 B]
2023-04-11T16:04:01.093 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [3,928 B]
2023-04-11T16:04:01.095 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,627 kB]
2023-04-11T16:04:01.118 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [539 kB]
2023-04-11T16:04:01.124 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [1,200 kB]
2023-04-11T16:04:01.134 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [38.5 kB]
2023-04-11T16:04:01.135 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [166 kB]
2023-04-11T16:04:01.136 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,656 kB]
2023-04-11T16:04:01.152 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,896 kB]
2023-04-11T16:04:01.201 INFO:teuthology.orchestra.run.smithi159.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [2,946 kB]
2023-04-11T16:04:01.203 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [415 kB]
2023-04-11T16:04:01.311 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [11.2 kB]
2023-04-11T16:04:01.312 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [25.6 kB]
2023-04-11T16:04:01.312 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,088 B]
2023-04-11T16:04:01.313 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic-backports/main i386 Packages [53.3 kB]
2023-04-11T16:04:01.314 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [53.3 kB]
2023-04-11T16:04:01.316 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [18.2 kB]
2023-04-11T16:04:01.317 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [18.1 kB]
2023-04-11T16:04:01.625 INFO:teuthology.orchestra.run.smithi159.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,627 kB]
2023-04-11T16:04:01.681 INFO:teuthology.orchestra.run.smithi159.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [539 kB]
2023-04-11T16:04:01.694 INFO:teuthology.orchestra.run.smithi159.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [1,200 kB]
2023-04-11T16:04:01.720 INFO:teuthology.orchestra.run.smithi159.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [38.5 kB]
2023-04-11T16:04:01.732 INFO:teuthology.orchestra.run.smithi159.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [166 kB]
2023-04-11T16:04:01.733 INFO:teuthology.orchestra.run.smithi159.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,656 kB]
2023-04-11T16:04:01.774 INFO:teuthology.orchestra.run.smithi159.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,896 kB]
2023-04-11T16:04:02.005 INFO:teuthology.orchestra.run.smithi159.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [415 kB]
2023-04-11T16:04:02.704 INFO:teuthology.orchestra.run.smithi159.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [25.6 kB]
2023-04-11T16:04:02.707 INFO:teuthology.orchestra.run.smithi159.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [11.2 kB]
2023-04-11T16:04:02.708 INFO:teuthology.orchestra.run.smithi159.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,088 B]
2023-04-11T16:04:02.709 INFO:teuthology.orchestra.run.smithi159.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [53.3 kB]
2023-04-11T16:04:02.825 INFO:teuthology.orchestra.run.smithi159.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic-backports/main i386 Packages [53.3 kB]
2023-04-11T16:04:02.826 INFO:teuthology.orchestra.run.smithi159.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [18.2 kB]
2023-04-11T16:04:02.827 INFO:teuthology.orchestra.run.smithi159.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [18.1 kB]
2023-04-11T16:04:03.601 INFO:teuthology.orchestra.run.smithi159.stdout:Fetched 19.4 MB in 3s (6,460 kB/s)
2023-04-11T16:04:03.603 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 19.4 MB in 3s (6,428 kB/s)
2023-04-11T16:04:05.184 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists...
2023-04-11T16:04:05.230 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists...
2023-04-11T16:04:05.233 DEBUG:teuthology.orchestra.run.smithi159:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic
2023-04-11T16:04:05.281 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic
2023-04-11T16:04:05.313 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists...
2023-04-11T16:04:05.368 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists...
2023-04-11T16:04:05.604 INFO:teuthology.orchestra.run.smithi159.stdout:Building dependency tree...
2023-04-11T16:04:05.604 INFO:teuthology.orchestra.run.smithi159.stdout:Reading state information...
2023-04-11T16:04:05.655 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree...
2023-04-11T16:04:05.656 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information...
2023-04-11T16:04:05.824 INFO:teuthology.orchestra.run.smithi159.stdout:The following additional packages will be installed:
2023-04-11T16:04:05.824 INFO:teuthology.orchestra.run.smithi159.stdout:  linux-generic linux-headers-4.15.0-208 linux-headers-4.15.0-208-generic
2023-04-11T16:04:05.824 INFO:teuthology.orchestra.run.smithi159.stdout:  linux-headers-generic linux-image-4.15.0-208-generic
2023-04-11T16:04:05.825 INFO:teuthology.orchestra.run.smithi159.stdout:  linux-modules-4.15.0-208-generic linux-modules-extra-4.15.0-208-generic
2023-04-11T16:04:05.827 INFO:teuthology.orchestra.run.smithi159.stdout:Suggested packages:
2023-04-11T16:04:05.827 INFO:teuthology.orchestra.run.smithi159.stdout:  fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools
2023-04-11T16:04:05.827 INFO:teuthology.orchestra.run.smithi159.stdout:Recommended packages:
2023-04-11T16:04:05.827 INFO:teuthology.orchestra.run.smithi159.stdout:  thermald
2023-04-11T16:04:05.871 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed:
2023-04-11T16:04:05.871 INFO:teuthology.orchestra.run.smithi187.stdout:  linux-generic linux-headers-4.15.0-208 linux-headers-4.15.0-208-generic
2023-04-11T16:04:05.872 INFO:teuthology.orchestra.run.smithi187.stdout:  linux-headers-generic linux-image-4.15.0-208-generic
2023-04-11T16:04:05.872 INFO:teuthology.orchestra.run.smithi187.stdout:  linux-modules-4.15.0-208-generic linux-modules-extra-4.15.0-208-generic
2023-04-11T16:04:05.872 INFO:teuthology.orchestra.run.smithi159.stdout:The following NEW packages will be installed:
2023-04-11T16:04:05.873 INFO:teuthology.orchestra.run.smithi159.stdout:  linux-headers-4.15.0-208 linux-headers-4.15.0-208-generic
2023-04-11T16:04:05.873 INFO:teuthology.orchestra.run.smithi159.stdout:  linux-image-4.15.0-208-generic linux-modules-4.15.0-208-generic
2023-04-11T16:04:05.873 INFO:teuthology.orchestra.run.smithi159.stdout:  linux-modules-extra-4.15.0-208-generic
2023-04-11T16:04:05.874 INFO:teuthology.orchestra.run.smithi159.stdout:The following packages will be upgraded:
2023-04-11T16:04:05.874 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages:
2023-04-11T16:04:05.874 INFO:teuthology.orchestra.run.smithi187.stdout:  fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools
2023-04-11T16:04:05.874 INFO:teuthology.orchestra.run.smithi187.stdout:Recommended packages:
2023-04-11T16:04:05.875 INFO:teuthology.orchestra.run.smithi187.stdout:  thermald
2023-04-11T16:04:05.875 INFO:teuthology.orchestra.run.smithi159.stdout:  linux-generic linux-headers-generic linux-image-generic
2023-04-11T16:04:05.922 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed:
2023-04-11T16:04:05.922 INFO:teuthology.orchestra.run.smithi187.stdout:  linux-headers-4.15.0-208 linux-headers-4.15.0-208-generic
2023-04-11T16:04:05.922 INFO:teuthology.orchestra.run.smithi187.stdout:  linux-image-4.15.0-208-generic linux-modules-4.15.0-208-generic
2023-04-11T16:04:05.923 INFO:teuthology.orchestra.run.smithi187.stdout:  linux-modules-extra-4.15.0-208-generic
2023-04-11T16:04:05.924 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages will be upgraded:
2023-04-11T16:04:05.925 INFO:teuthology.orchestra.run.smithi187.stdout:  linux-generic linux-headers-generic linux-image-generic
2023-04-11T16:04:05.930 INFO:teuthology.orchestra.run.smithi159.stdout:3 upgraded, 5 newly installed, 0 to remove and 137 not upgraded.
2023-04-11T16:04:05.930 INFO:teuthology.orchestra.run.smithi159.stdout:Need to get 67.5 MB of archives.
2023-04-11T16:04:05.931 INFO:teuthology.orchestra.run.smithi159.stdout:After this operation, 351 MB of additional disk space will be used.
2023-04-11T16:04:05.931 INFO:teuthology.orchestra.run.smithi159.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-208-generic amd64 4.15.0-208.220 [13.4 MB]
2023-04-11T16:04:05.980 INFO:teuthology.orchestra.run.smithi187.stdout:3 upgraded, 5 newly installed, 0 to remove and 137 not upgraded.
2023-04-11T16:04:05.980 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 67.5 MB of archives.
2023-04-11T16:04:05.980 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 351 MB of additional disk space will be used.
2023-04-11T16:04:05.980 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-208-generic amd64 4.15.0-208.220 [13.4 MB]
2023-04-11T16:04:06.222 INFO:teuthology.orchestra.run.smithi159.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-208-generic amd64 4.15.0-208.220 [8,109 kB]
2023-04-11T16:04:06.262 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-208-generic amd64 4.15.0-208.220 [8,109 kB]
2023-04-11T16:04:06.321 INFO:teuthology.orchestra.run.smithi159.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-208-generic amd64 4.15.0-208.220 [33.7 MB]
2023-04-11T16:04:06.364 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-208-generic amd64 4.15.0-208.220 [33.7 MB]
2023-04-11T16:04:06.758 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.208.191 [1,864 B]
2023-04-11T16:04:06.758 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.208.191 [2,464 B]
2023-04-11T16:04:06.759 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-208 all 4.15.0-208.220 [11.0 MB]
2023-04-11T16:04:06.775 INFO:teuthology.orchestra.run.smithi159.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.208.191 [1,864 B]
2023-04-11T16:04:06.775 INFO:teuthology.orchestra.run.smithi159.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.208.191 [2,464 B]
2023-04-11T16:04:06.775 INFO:teuthology.orchestra.run.smithi159.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-208 all 4.15.0-208.220 [11.0 MB]
2023-04-11T16:04:06.885 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-208-generic amd64 4.15.0-208.220 [1,264 kB]
2023-04-11T16:04:06.899 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.208.191 [2,360 B]
2023-04-11T16:04:06.905 INFO:teuthology.orchestra.run.smithi159.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-208-generic amd64 4.15.0-208.220 [1,264 kB]
2023-04-11T16:04:06.919 INFO:teuthology.orchestra.run.smithi159.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.208.191 [2,360 B]
2023-04-11T16:04:07.452 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 67.5 MB in 1s (70.5 MB/s)
2023-04-11T16:04:07.513 INFO:teuthology.orchestra.run.smithi159.stdout:Fetched 67.5 MB in 1s (65.7 MB/s)
2023-04-11T16:04:07.600 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-modules-4.15.0-208-generic.
2023-04-11T16:04:07.655 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-modules-4.15.0-208-generic.
2023-04-11T16:04:07.685 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... 
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 135963 files and directories currently installed.)
2023-04-11T16:04:07.688 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../0-linux-modules-4.15.0-208-generic_4.15.0-208.220_amd64.deb ...
2023-04-11T16:04:07.742 INFO:teuthology.orchestra.run.smithi159.stdout:(Reading database ... 
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 135963 files and directories currently installed.)
2023-04-11T16:04:07.746 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../0-linux-modules-4.15.0-208-generic_4.15.0-208.220_amd64.deb ...
2023-04-11T16:04:07.755 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-modules-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:07.785 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-modules-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:09.439 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-image-4.15.0-208-generic.
2023-04-11T16:04:09.456 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../1-linux-image-4.15.0-208-generic_4.15.0-208.220_amd64.deb ...
2023-04-11T16:04:09.486 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-image-4.15.0-208-generic.
2023-04-11T16:04:09.500 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../1-linux-image-4.15.0-208-generic_4.15.0-208.220_amd64.deb ...
2023-04-11T16:04:09.546 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-image-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:09.605 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-image-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:10.092 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-208-generic.
2023-04-11T16:04:10.106 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-208-generic_4.15.0-208.220_amd64.deb ...
2023-04-11T16:04:10.139 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-208-generic.
2023-04-11T16:04:10.149 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-208-generic_4.15.0-208.220_amd64.deb ...
2023-04-11T16:04:10.150 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-modules-extra-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:10.189 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-modules-extra-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:13.934 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../3-linux-generic_4.15.0.208.191_amd64.deb ...
2023-04-11T16:04:13.998 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../3-linux-generic_4.15.0.208.191_amd64.deb ...
2023-04-11T16:04:14.035 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-generic (4.15.0.208.191) over (4.15.0.200.183) ...
2023-04-11T16:04:14.122 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-generic (4.15.0.208.191) over (4.15.0.200.183) ...
2023-04-11T16:04:14.354 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.208.191_amd64.deb ...
2023-04-11T16:04:14.459 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.208.191_amd64.deb ...
2023-04-11T16:04:14.480 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-image-generic (4.15.0.208.191) over (4.15.0.200.183) ...
2023-04-11T16:04:14.584 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-image-generic (4.15.0.208.191) over (4.15.0.200.183) ...
2023-04-11T16:04:14.808 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-headers-4.15.0-208.
2023-04-11T16:04:14.823 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../5-linux-headers-4.15.0-208_4.15.0-208.220_all.deb ...
2023-04-11T16:04:14.866 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-headers-4.15.0-208 (4.15.0-208.220) ...
2023-04-11T16:04:14.887 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-headers-4.15.0-208.
2023-04-11T16:04:14.902 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../5-linux-headers-4.15.0-208_4.15.0-208.220_all.deb ...
2023-04-11T16:04:14.937 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-4.15.0-208 (4.15.0-208.220) ...
2023-04-11T16:04:19.479 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-headers-4.15.0-208-generic.
2023-04-11T16:04:19.504 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../6-linux-headers-4.15.0-208-generic_4.15.0-208.220_amd64.deb ...
2023-04-11T16:04:19.546 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-headers-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:20.208 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-headers-4.15.0-208-generic.
2023-04-11T16:04:20.231 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../6-linux-headers-4.15.0-208-generic_4.15.0-208.220_amd64.deb ...
2023-04-11T16:04:20.274 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:21.912 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.208.191_amd64.deb ...
2023-04-11T16:04:22.040 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-headers-generic (4.15.0.208.191) over (4.15.0.200.183) ...
2023-04-11T16:04:22.367 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-modules-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:22.672 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.208.191_amd64.deb ...
2023-04-11T16:04:22.831 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-generic (4.15.0.208.191) over (4.15.0.200.183) ...
2023-04-11T16:04:22.979 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-headers-4.15.0-208 (4.15.0-208.220) ...
2023-04-11T16:04:23.105 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-image-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:23.168 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-modules-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:23.591 INFO:teuthology.orchestra.run.smithi159.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-4.15.0-200-generic
2023-04-11T16:04:23.591 INFO:teuthology.orchestra.run.smithi159.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-4.15.0-200-generic
2023-04-11T16:04:23.591 INFO:teuthology.orchestra.run.smithi159.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-208-generic
2023-04-11T16:04:23.592 INFO:teuthology.orchestra.run.smithi159.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-208-generic
2023-04-11T16:04:23.723 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-headers-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:23.755 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-4.15.0-208 (4.15.0-208.220) ...
2023-04-11T16:04:23.849 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-modules-extra-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:23.880 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-image-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:24.375 INFO:teuthology.orchestra.run.smithi187.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-4.15.0-200-generic
2023-04-11T16:04:24.375 INFO:teuthology.orchestra.run.smithi187.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-4.15.0-200-generic
2023-04-11T16:04:24.375 INFO:teuthology.orchestra.run.smithi187.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-208-generic
2023-04-11T16:04:24.375 INFO:teuthology.orchestra.run.smithi187.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-208-generic
2023-04-11T16:04:24.409 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-headers-generic (4.15.0.208.191) ...
2023-04-11T16:04:24.499 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:24.544 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-image-generic (4.15.0.208.191) ...
2023-04-11T16:04:24.634 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-modules-extra-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:24.670 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-generic (4.15.0.208.191) ...
2023-04-11T16:04:24.796 INFO:teuthology.orchestra.run.smithi159.stdout:Processing triggers for linux-image-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:24.998 INFO:teuthology.orchestra.run.smithi159.stdout:/etc/kernel/postinst.d/initramfs-tools:
2023-04-11T16:04:24.998 INFO:teuthology.orchestra.run.smithi159.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-208-generic
2023-04-11T16:04:25.177 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-generic (4.15.0.208.191) ...
2023-04-11T16:04:25.286 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-image-generic (4.15.0.208.191) ...
2023-04-11T16:04:25.387 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-generic (4.15.0.208.191) ...
2023-04-11T16:04:25.513 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for linux-image-4.15.0-208-generic (4.15.0-208.220) ...
2023-04-11T16:04:25.735 INFO:teuthology.orchestra.run.smithi187.stdout:/etc/kernel/postinst.d/initramfs-tools:
2023-04-11T16:04:25.736 INFO:teuthology.orchestra.run.smithi187.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-208-generic
2023-04-11T16:04:40.659 INFO:teuthology.orchestra.run.smithi159.stdout:/etc/kernel/postinst.d/zz-update-grub:
2023-04-11T16:04:40.659 INFO:teuthology.orchestra.run.smithi159.stdout:Sourcing file `/etc/default/grub'
2023-04-11T16:04:40.688 INFO:teuthology.orchestra.run.smithi159.stdout:Generating grub configuration file ...
2023-04-11T16:04:41.078 INFO:teuthology.orchestra.run.smithi159.stdout:Found linux image: /boot/vmlinuz-4.15.0-208-generic
2023-04-11T16:04:41.126 INFO:teuthology.orchestra.run.smithi159.stdout:Found initrd image: /boot/initrd.img-4.15.0-208-generic
2023-04-11T16:04:41.485 INFO:teuthology.orchestra.run.smithi159.stdout:Found linux image: /boot/vmlinuz-4.15.0-200-generic
2023-04-11T16:04:41.523 INFO:teuthology.orchestra.run.smithi159.stdout:Found initrd image: /boot/initrd.img-4.15.0-200-generic
2023-04-11T16:04:41.590 INFO:teuthology.orchestra.run.smithi159.stdout:Found linux image: /boot/vmlinuz-4.15.0-194-generic
2023-04-11T16:04:41.636 INFO:teuthology.orchestra.run.smithi159.stdout:Found initrd image: /boot/initrd.img-4.15.0-194-generic
2023-04-11T16:04:41.698 INFO:teuthology.orchestra.run.smithi187.stdout:/etc/kernel/postinst.d/zz-update-grub:
2023-04-11T16:04:41.699 INFO:teuthology.orchestra.run.smithi187.stdout:Sourcing file `/etc/default/grub'
2023-04-11T16:04:41.744 INFO:teuthology.orchestra.run.smithi187.stdout:Generating grub configuration file ...
2023-04-11T16:04:42.124 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-4.15.0-208-generic
2023-04-11T16:04:42.174 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-4.15.0-208-generic
2023-04-11T16:04:42.507 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-4.15.0-200-generic
2023-04-11T16:04:42.540 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-4.15.0-200-generic
2023-04-11T16:04:42.616 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-4.15.0-194-generic
2023-04-11T16:04:42.643 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-4.15.0-194-generic
2023-04-11T16:04:43.320 INFO:teuthology.orchestra.run.smithi159.stdout:done
2023-04-11T16:04:43.795 DEBUG:teuthology.orchestra.run.smithi159:> dpkg -s linux-image-generic
2023-04-11T16:04:43.819 INFO:teuthology.orchestra.run.smithi159.stdout:Package: linux-image-generic
2023-04-11T16:04:43.819 INFO:teuthology.orchestra.run.smithi159.stdout:Status: install ok installed
2023-04-11T16:04:43.819 INFO:teuthology.orchestra.run.smithi159.stdout:Priority: optional
2023-04-11T16:04:43.819 INFO:teuthology.orchestra.run.smithi159.stdout:Section: kernel
2023-04-11T16:04:43.819 INFO:teuthology.orchestra.run.smithi159.stdout:Installed-Size: 18
2023-04-11T16:04:43.820 INFO:teuthology.orchestra.run.smithi159.stdout:Maintainer: Ubuntu Kernel Team <kernel-team@lists.ubuntu.com>
2023-04-11T16:04:43.820 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: amd64
2023-04-11T16:04:43.820 INFO:teuthology.orchestra.run.smithi159.stdout:Source: linux-meta
2023-04-11T16:04:43.820 INFO:teuthology.orchestra.run.smithi159.stdout:Version: 4.15.0.208.191
2023-04-11T16:04:43.820 INFO:teuthology.orchestra.run.smithi159.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.4), zfs-modules (= 0.7.5-1ubuntu16.12)
2023-04-11T16:04:43.820 INFO:teuthology.orchestra.run.smithi159.stdout:Depends: linux-image-4.15.0-208-generic, linux-modules-extra-4.15.0-208-generic, linux-firmware, intel-microcode, amd64-microcode
2023-04-11T16:04:43.820 INFO:teuthology.orchestra.run.smithi159.stdout:Recommends: thermald
2023-04-11T16:04:43.821 INFO:teuthology.orchestra.run.smithi159.stdout:Description: Generic Linux kernel image
2023-04-11T16:04:43.821 INFO:teuthology.orchestra.run.smithi159.stdout: This package will always depend on the latest generic kernel image
2023-04-11T16:04:43.821 INFO:teuthology.orchestra.run.smithi159.stdout: available.
2023-04-11T16:04:43.821 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-200-generic Expected: 4.15.0-208-generic
2023-04-11T16:04:43.821 INFO:teuthology.task.kernel:Skipping firmware on distro kernel
2023-04-11T16:04:43.821 DEBUG:teuthology.task.kernel:src is distro, skipping download
2023-04-11T16:04:43.822 INFO:teuthology.task.kernel:Installing distro kernel on host.a...
2023-04-11T16:04:43.822 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi159.front.sepia.ceph.com, path=None, version=distro)
2023-04-11T16:04:43.822 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-get clean
2023-04-11T16:04:43.943 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-get update
2023-04-11T16:04:44.072 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease
2023-04-11T16:04:44.077 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease
2023-04-11T16:04:44.094 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease
2023-04-11T16:04:44.110 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease
2023-04-11T16:04:44.298 INFO:teuthology.orchestra.run.smithi187.stdout:done
2023-04-11T16:04:44.773 DEBUG:teuthology.orchestra.run.smithi187:> dpkg -s linux-image-generic
2023-04-11T16:04:44.795 INFO:teuthology.orchestra.run.smithi187.stdout:Package: linux-image-generic
2023-04-11T16:04:44.795 INFO:teuthology.orchestra.run.smithi187.stdout:Status: install ok installed
2023-04-11T16:04:44.795 INFO:teuthology.orchestra.run.smithi187.stdout:Priority: optional
2023-04-11T16:04:44.795 INFO:teuthology.orchestra.run.smithi187.stdout:Section: kernel
2023-04-11T16:04:44.795 INFO:teuthology.orchestra.run.smithi187.stdout:Installed-Size: 18
2023-04-11T16:04:44.796 INFO:teuthology.orchestra.run.smithi187.stdout:Maintainer: Ubuntu Kernel Team <kernel-team@lists.ubuntu.com>
2023-04-11T16:04:44.796 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: amd64
2023-04-11T16:04:44.796 INFO:teuthology.orchestra.run.smithi187.stdout:Source: linux-meta
2023-04-11T16:04:44.796 INFO:teuthology.orchestra.run.smithi187.stdout:Version: 4.15.0.208.191
2023-04-11T16:04:44.796 INFO:teuthology.orchestra.run.smithi187.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.4), zfs-modules (= 0.7.5-1ubuntu16.12)
2023-04-11T16:04:44.796 INFO:teuthology.orchestra.run.smithi187.stdout:Depends: linux-image-4.15.0-208-generic, linux-modules-extra-4.15.0-208-generic, linux-firmware, intel-microcode, amd64-microcode
2023-04-11T16:04:44.796 INFO:teuthology.orchestra.run.smithi187.stdout:Recommends: thermald
2023-04-11T16:04:44.796 INFO:teuthology.orchestra.run.smithi187.stdout:Description: Generic Linux kernel image
2023-04-11T16:04:44.797 INFO:teuthology.orchestra.run.smithi187.stdout: This package will always depend on the latest generic kernel image
2023-04-11T16:04:44.797 INFO:teuthology.orchestra.run.smithi187.stdout: available.
2023-04-11T16:04:44.797 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-200-generic Expected: 4.15.0-208-generic
2023-04-11T16:04:44.797 INFO:teuthology.task.kernel:Skipping firmware on distro kernel
2023-04-11T16:04:44.797 DEBUG:teuthology.task.kernel:src is distro, skipping download
2023-04-11T16:04:44.798 INFO:teuthology.task.kernel:Installing distro kernel on host.b...
2023-04-11T16:04:44.798 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi187.front.sepia.ceph.com, path=None, version=distro)
2023-04-11T16:04:44.798 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get clean
2023-04-11T16:04:44.900 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update
2023-04-11T16:04:45.024 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease
2023-04-11T16:04:45.030 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic-updates InRelease
2023-04-11T16:04:45.047 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-backports InRelease
2023-04-11T16:04:45.142 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:4 http://security.ubuntu.com/ubuntu bionic-security InRelease
2023-04-11T16:04:46.142 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists...
2023-04-11T16:04:46.196 DEBUG:teuthology.orchestra.run.smithi159:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic
2023-04-11T16:04:46.277 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists...
2023-04-11T16:04:46.556 INFO:teuthology.orchestra.run.smithi159.stdout:Building dependency tree...
2023-04-11T16:04:46.556 INFO:teuthology.orchestra.run.smithi159.stdout:Reading state information...
2023-04-11T16:04:46.758 INFO:teuthology.orchestra.run.smithi159.stdout:linux-image-generic is already the newest version (4.15.0.208.191).
2023-04-11T16:04:46.759 INFO:teuthology.orchestra.run.smithi159.stdout:The following packages were automatically installed and are no longer required:
2023-04-11T16:04:46.759 INFO:teuthology.orchestra.run.smithi159.stdout:  linux-headers-4.15.0-194 linux-headers-4.15.0-194-generic
2023-04-11T16:04:46.759 INFO:teuthology.orchestra.run.smithi159.stdout:  linux-image-4.15.0-194-generic linux-modules-4.15.0-194-generic
2023-04-11T16:04:46.759 INFO:teuthology.orchestra.run.smithi159.stdout:  linux-modules-extra-4.15.0-194-generic
2023-04-11T16:04:46.759 INFO:teuthology.orchestra.run.smithi159.stdout:Use 'sudo apt autoremove' to remove them.
2023-04-11T16:04:46.811 INFO:teuthology.orchestra.run.smithi159.stdout:0 upgraded, 0 newly installed, 0 to remove and 137 not upgraded.
2023-04-11T16:04:46.813 DEBUG:teuthology.orchestra.run.smithi159:> dpkg -s linux-image-generic
2023-04-11T16:04:46.831 INFO:teuthology.orchestra.run.smithi159.stdout:Package: linux-image-generic
2023-04-11T16:04:46.831 INFO:teuthology.orchestra.run.smithi159.stdout:Status: install ok installed
2023-04-11T16:04:46.831 INFO:teuthology.orchestra.run.smithi159.stdout:Priority: optional
2023-04-11T16:04:46.832 INFO:teuthology.orchestra.run.smithi159.stdout:Section: kernel
2023-04-11T16:04:46.832 INFO:teuthology.orchestra.run.smithi159.stdout:Installed-Size: 18
2023-04-11T16:04:46.832 INFO:teuthology.orchestra.run.smithi159.stdout:Maintainer: Ubuntu Kernel Team <kernel-team@lists.ubuntu.com>
2023-04-11T16:04:46.832 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: amd64
2023-04-11T16:04:46.832 INFO:teuthology.orchestra.run.smithi159.stdout:Source: linux-meta
2023-04-11T16:04:46.832 INFO:teuthology.orchestra.run.smithi159.stdout:Version: 4.15.0.208.191
2023-04-11T16:04:46.832 INFO:teuthology.orchestra.run.smithi159.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.4), zfs-modules (= 0.7.5-1ubuntu16.12)
2023-04-11T16:04:46.833 INFO:teuthology.orchestra.run.smithi159.stdout:Depends: linux-image-4.15.0-208-generic, linux-modules-extra-4.15.0-208-generic, linux-firmware, intel-microcode, amd64-microcode
2023-04-11T16:04:46.833 INFO:teuthology.orchestra.run.smithi159.stdout:Recommends: thermald
2023-04-11T16:04:46.833 INFO:teuthology.orchestra.run.smithi159.stdout:Description: Generic Linux kernel image
2023-04-11T16:04:46.833 INFO:teuthology.orchestra.run.smithi159.stdout: This package will always depend on the latest generic kernel image
2023-04-11T16:04:46.833 INFO:teuthology.orchestra.run.smithi159.stdout: available.
2023-04-11T16:04:46.834 DEBUG:teuthology.orchestra.run.smithi159:> mktemp
2023-04-11T16:04:46.880 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.Ku6sT67pcG
2023-04-11T16:04:46.880 DEBUG:teuthology.orchestra.run.smithi159:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Ku6sT67pcG
2023-04-11T16:04:46.937 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.Ku6sT67pcG
2023-04-11T16:04:47.060 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.Ku6sT67pcG is 10KB
2023-04-11T16:04:47.070 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.Ku6sT67pcG
2023-04-11T16:04:47.076 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/grub.d/01_ceph_kernel
2023-04-11T16:04:47.092 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists...
2023-04-11T16:04:47.132 DEBUG:teuthology.orchestra.run.smithi159:> set -ex
2023-04-11T16:04:47.132 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/grub.d/01_ceph_kernel
2023-04-11T16:04:47.133 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 755 /etc/grub.d/01_ceph_kernel
2023-04-11T16:04:47.145 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic
2023-04-11T16:04:47.226 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists...
2023-04-11T16:04:47.229 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-208-generic
2023-04-11T16:04:47.229 DEBUG:teuthology.orchestra.run.smithi159:> sudo update-grub
2023-04-11T16:04:47.497 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree...
2023-04-11T16:04:47.498 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information...
2023-04-11T16:04:47.715 INFO:teuthology.orchestra.run.smithi187.stdout:linux-image-generic is already the newest version (4.15.0.208.191).
2023-04-11T16:04:47.716 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required:
2023-04-11T16:04:47.716 INFO:teuthology.orchestra.run.smithi187.stdout:  linux-headers-4.15.0-194 linux-headers-4.15.0-194-generic
2023-04-11T16:04:47.716 INFO:teuthology.orchestra.run.smithi187.stdout:  linux-image-4.15.0-194-generic linux-modules-4.15.0-194-generic
2023-04-11T16:04:47.716 INFO:teuthology.orchestra.run.smithi187.stdout:  linux-modules-extra-4.15.0-194-generic
2023-04-11T16:04:47.717 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them.
2023-04-11T16:04:47.773 INFO:teuthology.orchestra.run.smithi187.stdout:0 upgraded, 0 newly installed, 0 to remove and 137 not upgraded.
2023-04-11T16:04:47.775 DEBUG:teuthology.orchestra.run.smithi187:> dpkg -s linux-image-generic
2023-04-11T16:04:47.795 INFO:teuthology.orchestra.run.smithi187.stdout:Package: linux-image-generic
2023-04-11T16:04:47.795 INFO:teuthology.orchestra.run.smithi187.stdout:Status: install ok installed
2023-04-11T16:04:47.796 INFO:teuthology.orchestra.run.smithi187.stdout:Priority: optional
2023-04-11T16:04:47.796 INFO:teuthology.orchestra.run.smithi187.stdout:Section: kernel
2023-04-11T16:04:47.796 INFO:teuthology.orchestra.run.smithi187.stdout:Installed-Size: 18
2023-04-11T16:04:47.796 INFO:teuthology.orchestra.run.smithi187.stdout:Maintainer: Ubuntu Kernel Team <kernel-team@lists.ubuntu.com>
2023-04-11T16:04:47.796 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: amd64
2023-04-11T16:04:47.796 INFO:teuthology.orchestra.run.smithi187.stdout:Source: linux-meta
2023-04-11T16:04:47.796 INFO:teuthology.orchestra.run.smithi187.stdout:Version: 4.15.0.208.191
2023-04-11T16:04:47.796 INFO:teuthology.orchestra.run.smithi187.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.4), zfs-modules (= 0.7.5-1ubuntu16.12)
2023-04-11T16:04:47.797 INFO:teuthology.orchestra.run.smithi187.stdout:Depends: linux-image-4.15.0-208-generic, linux-modules-extra-4.15.0-208-generic, linux-firmware, intel-microcode, amd64-microcode
2023-04-11T16:04:47.797 INFO:teuthology.orchestra.run.smithi187.stdout:Recommends: thermald
2023-04-11T16:04:47.797 INFO:teuthology.orchestra.run.smithi187.stdout:Description: Generic Linux kernel image
2023-04-11T16:04:47.797 INFO:teuthology.orchestra.run.smithi187.stdout: This package will always depend on the latest generic kernel image
2023-04-11T16:04:47.797 INFO:teuthology.orchestra.run.smithi187.stdout: available.
2023-04-11T16:04:47.798 DEBUG:teuthology.orchestra.run.smithi187:> mktemp
2023-04-11T16:04:47.843 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.h3VueVKZef
2023-04-11T16:04:47.843 DEBUG:teuthology.orchestra.run.smithi187:> sudo cp /boot/grub/grub.cfg /tmp/tmp.h3VueVKZef
2023-04-11T16:04:47.899 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.h3VueVKZef
2023-04-11T16:04:48.015 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.h3VueVKZef is 10KB
2023-04-11T16:04:48.024 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.h3VueVKZef
2023-04-11T16:04:48.030 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/grub.d/01_ceph_kernel
2023-04-11T16:04:48.087 DEBUG:teuthology.orchestra.run.smithi187:> set -ex
2023-04-11T16:04:48.087 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/grub.d/01_ceph_kernel
2023-04-11T16:04:48.088 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 755 /etc/grub.d/01_ceph_kernel
2023-04-11T16:04:48.160 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-208-generic
2023-04-11T16:04:48.161 DEBUG:teuthology.orchestra.run.smithi187:> sudo update-grub
2023-04-11T16:04:48.624 INFO:teuthology.orchestra.run.smithi159.stderr:Sourcing file `/etc/default/grub'
2023-04-11T16:04:48.635 INFO:teuthology.orchestra.run.smithi159.stderr:Generating grub configuration file ...
2023-04-11T16:04:48.886 INFO:teuthology.orchestra.run.smithi159.stderr:Found linux image: /boot/vmlinuz-4.15.0-208-generic
2023-04-11T16:04:48.899 INFO:teuthology.orchestra.run.smithi159.stderr:Found initrd image: /boot/initrd.img-4.15.0-208-generic
2023-04-11T16:04:49.195 INFO:teuthology.orchestra.run.smithi159.stderr:Found linux image: /boot/vmlinuz-4.15.0-200-generic
2023-04-11T16:04:49.206 INFO:teuthology.orchestra.run.smithi159.stderr:Found initrd image: /boot/initrd.img-4.15.0-200-generic
2023-04-11T16:04:49.281 INFO:teuthology.orchestra.run.smithi159.stderr:Found linux image: /boot/vmlinuz-4.15.0-194-generic
2023-04-11T16:04:49.295 INFO:teuthology.orchestra.run.smithi159.stderr:Found initrd image: /boot/initrd.img-4.15.0-194-generic
2023-04-11T16:04:49.602 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub'
2023-04-11T16:04:49.616 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ...
2023-04-11T16:04:49.913 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-4.15.0-208-generic
2023-04-11T16:04:49.925 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-4.15.0-208-generic
2023-04-11T16:04:50.292 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-4.15.0-200-generic
2023-04-11T16:04:50.304 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-4.15.0-200-generic
2023-04-11T16:04:50.380 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-4.15.0-194-generic
2023-04-11T16:04:50.393 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-4.15.0-194-generic
2023-04-11T16:04:50.549 INFO:teuthology.orchestra.run.smithi159.stderr:done
2023-04-11T16:04:50.551 DEBUG:teuthology.orchestra.run.smithi159:> sudo shutdown -r now
2023-04-11T16:04:51.619 INFO:teuthology.orchestra.run.smithi187.stderr:done
2023-04-11T16:04:51.621 DEBUG:teuthology.orchestra.run.smithi187:> sudo shutdown -r now
2023-04-11T16:05:20.581 INFO:teuthology.task.kernel:Checking client host.a for new kernel version...
2023-04-11T16:05:20.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-04-11T16:05:20.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-04-11T16:05:21.625 INFO:teuthology.task.kernel:Checking client host.b for new kernel version...
2023-04-11T16:05:21.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2023-04-11T16:05:21.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-04-11T16:05:38.949 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-04-11T16:05:39.977 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-04-11T16:06:08.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-04-11T16:06:08.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-04-11T16:06:09.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2023-04-11T16:06:09.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-04-11T16:06:27.333 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-04-11T16:06:28.357 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-04-11T16:06:57.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-04-11T16:06:57.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-04-11T16:06:57.441 DEBUG:teuthology.orchestra.run.smithi159:> true
2023-04-11T16:06:57.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-04-11T16:06:57.778 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.15.0-208-generic"...
2023-04-11T16:06:57.779 DEBUG:teuthology.orchestra.run.smithi159:> uname -r
2023-04-11T16:06:57.824 INFO:teuthology.orchestra.run.smithi159.stdout:4.15.0-208-generic
2023-04-11T16:06:57.825 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-208-generic vs 4.15.0-208-generic
2023-04-11T16:06:57.825 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install
2023-04-11T16:06:57.825 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu
2023-04-11T16:06:58.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2023-04-11T16:06:58.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-04-11T16:06:58.440 DEBUG:teuthology.orchestra.run.smithi187:> true
2023-04-11T16:06:58.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com'
2023-04-11T16:06:58.738 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.15.0-208-generic"...
2023-04-11T16:06:58.738 DEBUG:teuthology.orchestra.run.smithi187:> uname -r
2023-04-11T16:06:58.784 INFO:teuthology.orchestra.run.smithi187.stdout:4.15.0-208-generic
2023-04-11T16:06:58.784 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-208-generic vs 4.15.0-208-generic
2023-04-11T16:06:58.785 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install
2023-04-11T16:06:58.785 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu
2023-04-11T16:06:58.826 INFO:teuthology.task.kernel:Enabling kdb on host.a...
2023-04-11T16:06:58.827 DEBUG:teuthology.orchestra.run.smithi159:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc
2023-04-11T16:06:58.856 INFO:teuthology.orchestra.run.smithi159.stdout:ttyS1
2023-04-11T16:06:58.878 DEBUG:teuthology.parallel:result is None
2023-04-11T16:06:59.785 INFO:teuthology.task.kernel:Enabling kdb on host.b...
2023-04-11T16:06:59.786 DEBUG:teuthology.orchestra.run.smithi187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc
2023-04-11T16:07:00.047 INFO:teuthology.orchestra.run.smithi187.stdout:ttyS1
2023-04-11T16:07:00.084 DEBUG:teuthology.parallel:result is None
2023-04-11T16:07:00.085 INFO:teuthology.run_tasks:Running task internal.base...
2023-04-11T16:07:00.092 INFO:teuthology.task.internal:Creating test directory...
2023-04-11T16:07:00.093 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest
2023-04-11T16:07:00.095 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest
2023-04-11T16:07:00.102 INFO:teuthology.run_tasks:Running task internal.archive_upload...
2023-04-11T16:07:00.118 INFO:teuthology.run_tasks:Running task internal.archive...
2023-04-11T16:07:00.131 INFO:teuthology.task.internal:Creating archive directory...
2023-04-11T16:07:00.131 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive
2023-04-11T16:07:00.145 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive
2023-04-11T16:07:00.224 INFO:teuthology.run_tasks:Running task internal.coredump...
2023-04-11T16:07:00.233 INFO:teuthology.task.internal:Enabling coredump saving...
2023-04-11T16:07:00.233 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf
2023-04-11T16:07:00.236 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf
2023-04-11T16:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core
2023-04-11T16:07:00.259 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core
2023-04-11T16:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core
2023-04-11T16:07:00.269 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core
2023-04-11T16:07:00.271 INFO:teuthology.run_tasks:Running task internal.sudo...
2023-04-11T16:07:00.281 INFO:teuthology.task.internal:Configuring sudo...
2023-04-11T16:07:00.281 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers
2023-04-11T16:07:00.313 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers
2023-04-11T16:07:00.328 INFO:teuthology.run_tasks:Running task internal.syslog...
2023-04-11T16:07:00.338 INFO:teuthology.task.internal.syslog:Starting syslog monitoring...
2023-04-11T16:07:00.338 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog
2023-04-11T16:07:00.369 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog
2023-04-11T16:07:00.376 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log
2023-04-11T16:07:00.421 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log
2023-04-11T16:07:00.469 DEBUG:teuthology.orchestra.run.smithi159:> set -ex
2023-04-11T16:07:00.470 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf
2023-04-11T16:07:00.584 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log
2023-04-11T16:07:00.590 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log
2023-04-11T16:07:00.640 DEBUG:teuthology.orchestra.run.smithi187:> set -ex
2023-04-11T16:07:00.640 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf
2023-04-11T16:07:00.702 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart
2023-04-11T16:07:00.704 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart
2023-04-11T16:07:00.792 INFO:teuthology.run_tasks:Running task internal.timer...
2023-04-11T16:07:00.801 INFO:teuthology.task.internal:Starting timer...
2023-04-11T16:07:00.801 INFO:teuthology.run_tasks:Running task pcp...
2023-04-11T16:07:00.818 INFO:teuthology.run_tasks:Running task selinux...
2023-04-11T16:07:00.828 DEBUG:teuthology.task.selinux:Excluding smithi159: OS 'ubuntu' does not support SELinux
2023-04-11T16:07:00.828 DEBUG:teuthology.task.selinux:Excluding smithi187: OS 'ubuntu' does not support SELinux
2023-04-11T16:07:00.828 DEBUG:teuthology.task.selinux:Getting current SELinux state
2023-04-11T16:07:00.829 DEBUG:teuthology.task.selinux:Existing SELinux modes: {}
2023-04-11T16:07:00.829 INFO:teuthology.task.selinux:Putting SELinux into permissive mode
2023-04-11T16:07:00.829 INFO:teuthology.run_tasks:Running task ansible.cephlab...
2023-04-11T16:07:00.838 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current
2023-04-11T16:07:00.839 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main
2023-04-11T16:07:00.858 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}]
2023-04-11T16:07:00.859 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi159.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml
2023-04-11T16:12:09.680 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi159.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')]
2023-04-11T16:12:09.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-04-11T16:12:09.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-04-11T16:12:09.760 DEBUG:teuthology.orchestra.run.smithi159:> true
2023-04-11T16:12:09.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2023-04-11T16:12:09.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-04-11T16:12:09.954 DEBUG:teuthology.orchestra.run.smithi187:> true
2023-04-11T16:12:10.074 INFO:teuthology.run_tasks:Running task clock...
2023-04-11T16:12:10.084 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew...
2023-04-11T16:12:10.085 INFO:teuthology.orchestra.run:Running command with timeout 360
2023-04-11T16:12:10.085 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true
2023-04-11T16:12:10.087 INFO:teuthology.orchestra.run:Running command with timeout 360
2023-04-11T16:12:10.088 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true
2023-04-11T16:12:10.136 INFO:teuthology.orchestra.run.smithi159.stdout:11 Apr 16:12:10 ntpd[22595]: ntpd 4.2.8p10@1.3728-o (1): Starting
2023-04-11T16:12:10.137 INFO:teuthology.orchestra.run.smithi159.stdout:11 Apr 16:12:10 ntpd[22595]: Command line: ntpd -gq
2023-04-11T16:12:10.138 INFO:teuthology.orchestra.run.smithi159.stdout:11 Apr 16:12:10 ntpd[22595]: proto: precision = 0.123 usec (-23)
2023-04-11T16:12:10.138 INFO:teuthology.orchestra.run.smithi159.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED.
2023-04-11T16:12:10.139 INFO:teuthology.orchestra.run.smithi159.stdout:11 Apr 16:12:10 ntpd[22595]: restrict 0.0.0.0: KOD does nothing without LIMITED.
2023-04-11T16:12:10.139 INFO:teuthology.orchestra.run.smithi159.stderr:restrict ::: KOD does nothing without LIMITED.
2023-04-11T16:12:10.140 INFO:teuthology.orchestra.run.smithi159.stdout:11 Apr 16:12:10 ntpd[22595]: restrict ::: KOD does nothing without LIMITED.
2023-04-11T16:12:10.140 INFO:teuthology.orchestra.run.smithi159.stdout:11 Apr 16:12:10 ntpd[22595]: Listen and drop on 0 v6wildcard [::]:123
2023-04-11T16:12:10.140 INFO:teuthology.orchestra.run.smithi159.stdout:11 Apr 16:12:10 ntpd[22595]: Listen and drop on 1 v4wildcard 0.0.0.0:123
2023-04-11T16:12:10.140 INFO:teuthology.orchestra.run.smithi159.stdout:11 Apr 16:12:10 ntpd[22595]: Listen normally on 2 lo 127.0.0.1:123
2023-04-11T16:12:10.140 INFO:teuthology.orchestra.run.smithi159.stdout:11 Apr 16:12:10 ntpd[22595]: Listen normally on 3 enp3s0f1 172.21.15.159:123
2023-04-11T16:12:10.141 INFO:teuthology.orchestra.run.smithi159.stdout:11 Apr 16:12:10 ntpd[22595]: Listen normally on 4 lo [::1]:123
2023-04-11T16:12:10.141 INFO:teuthology.orchestra.run.smithi159.stdout:11 Apr 16:12:10 ntpd[22595]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:724f%5]:123
2023-04-11T16:12:10.141 INFO:teuthology.orchestra.run.smithi159.stdout:11 Apr 16:12:10 ntpd[22595]: Listening on routing socket on fd #22 for interface updates
2023-04-11T16:12:10.172 INFO:teuthology.orchestra.run.smithi187.stdout:11 Apr 16:12:10 ntpd[22435]: ntpd 4.2.8p10@1.3728-o (1): Starting
2023-04-11T16:12:10.172 INFO:teuthology.orchestra.run.smithi187.stdout:11 Apr 16:12:10 ntpd[22435]: Command line: ntpd -gq
2023-04-11T16:12:10.173 INFO:teuthology.orchestra.run.smithi187.stdout:11 Apr 16:12:10 ntpd[22435]: proto: precision = 0.114 usec (-23)
2023-04-11T16:12:10.173 INFO:teuthology.orchestra.run.smithi187.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED.
2023-04-11T16:12:10.174 INFO:teuthology.orchestra.run.smithi187.stdout:11 Apr 16:12:10 ntpd[22435]: restrict 0.0.0.0: KOD does nothing without LIMITED.
2023-04-11T16:12:10.174 INFO:teuthology.orchestra.run.smithi187.stderr:restrict ::: KOD does nothing without LIMITED.
2023-04-11T16:12:10.175 INFO:teuthology.orchestra.run.smithi187.stdout:11 Apr 16:12:10 ntpd[22435]: restrict ::: KOD does nothing without LIMITED.
2023-04-11T16:12:10.175 INFO:teuthology.orchestra.run.smithi187.stdout:11 Apr 16:12:10 ntpd[22435]: Listen and drop on 0 v6wildcard [::]:123
2023-04-11T16:12:10.175 INFO:teuthology.orchestra.run.smithi187.stdout:11 Apr 16:12:10 ntpd[22435]: Listen and drop on 1 v4wildcard 0.0.0.0:123
2023-04-11T16:12:10.175 INFO:teuthology.orchestra.run.smithi187.stdout:11 Apr 16:12:10 ntpd[22435]: Listen normally on 2 lo 127.0.0.1:123
2023-04-11T16:12:10.175 INFO:teuthology.orchestra.run.smithi187.stdout:11 Apr 16:12:10 ntpd[22435]: Listen normally on 3 enp3s0f1 172.21.15.187:123
2023-04-11T16:12:10.176 INFO:teuthology.orchestra.run.smithi187.stdout:11 Apr 16:12:10 ntpd[22435]: Listen normally on 4 lo [::1]:123
2023-04-11T16:12:10.176 INFO:teuthology.orchestra.run.smithi187.stdout:11 Apr 16:12:10 ntpd[22435]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77b1%5]:123
2023-04-11T16:12:10.176 INFO:teuthology.orchestra.run.smithi187.stdout:11 Apr 16:12:10 ntpd[22435]: Listening on routing socket on fd #22 for interface updates
2023-04-11T16:12:12.137 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:12 ntpd[22595]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:12.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:12 ntpd[22595]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:12.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:12 ntpd[22595]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:12.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:12 ntpd[22595]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:12.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:12 ntpd[22435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:12.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:12 ntpd[22435]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:12.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:12 ntpd[22435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:12.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:12 ntpd[22435]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:13.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:13 ntpd[22435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:13.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:13 ntpd[22435]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:13.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:13 ntpd[22435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:13.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:13 ntpd[22435]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:13.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:13 ntpd[22435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:13.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:13 ntpd[22435]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:13.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:13 ntpd[22435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:13.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:13 ntpd[22435]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:14.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:14 ntpd[22595]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:14.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:14 ntpd[22595]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:14.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:14 ntpd[22595]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:14.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:14 ntpd[22595]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:14.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:14 ntpd[22595]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:14.139 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:14 ntpd[22595]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:14.139 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:14 ntpd[22595]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:14.139 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:14 ntpd[22595]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:14.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:14 ntpd[22435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:14.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:14 ntpd[22435]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:14.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:14 ntpd[22435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:14.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:14 ntpd[22435]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:15.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:15 ntpd[22595]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:15.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:15 ntpd[22595]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:15.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:15 ntpd[22595]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:15.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:15 ntpd[22595]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:15.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:15 ntpd[22435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:15.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:15 ntpd[22435]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:15.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:15 ntpd[22435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:15.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:15 ntpd[22435]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:15.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:15 ntpd[22435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:15.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:15 ntpd[22435]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:15.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:15 ntpd[22435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:15.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:15 ntpd[22435]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:16.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:16 ntpd[22595]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:16.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:16 ntpd[22595]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:16.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:16 ntpd[22595]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:16.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:16 ntpd[22595]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:16.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:16 ntpd[22595]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:16.139 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:16 ntpd[22595]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:16.139 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:16 ntpd[22595]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:16.139 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:16 ntpd[22595]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:16.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:16 ntpd[22435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:16.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:16 ntpd[22435]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:16.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:16 ntpd[22435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:16.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:16 ntpd[22435]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:17.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:17 ntpd[22595]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:17.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:17 ntpd[22595]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:17.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:17 ntpd[22595]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:17.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:17 ntpd[22595]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:17.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:17 ntpd[22435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:17.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:17 ntpd[22435]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:17.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:17 ntpd[22435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:17.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:17 ntpd[22435]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:17.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:17 ntpd[22435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:17.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:17 ntpd[22435]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:17.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:17 ntpd[22435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:17.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:17 ntpd[22435]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:18.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:18 ntpd[22595]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:18.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:18 ntpd[22595]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:18.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:18 ntpd[22595]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:18.138 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:18 ntpd[22595]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:18.138 INFO:teuthology.orchestra.run.smithi159.stdout:11 Apr 16:12:18 ntpd[22595]: ntpd: time slew +0.003502 s
2023-04-11T16:12:18.139 INFO:teuthology.orchestra.run.smithi159.stdout:ntpd: time slew +0.003502s
2023-04-11T16:12:18.139 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:18 ntpd[22595]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied
2023-04-11T16:12:18.139 INFO:teuthology.orchestra.run.smithi159.stderr:11 Apr 16:12:18 ntpd[22595]: can't open /var/log/ntpstats/loopstats.20230411: Permission denied
2023-04-11T16:12:18.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:18 ntpd[22435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2023-04-11T16:12:18.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:18 ntpd[22435]: can't open /var/log/ntpstats/rawstats.20230411: Permission denied
2023-04-11T16:12:18.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:18 ntpd[22435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2023-04-11T16:12:18.173 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:18 ntpd[22435]: can't open /var/log/ntpstats/peerstats.20230411: Permission denied
2023-04-11T16:12:18.174 INFO:teuthology.orchestra.run.smithi187.stdout:11 Apr 16:12:18 ntpd[22435]: ntpd: time slew +0.004365 s
2023-04-11T16:12:18.174 INFO:teuthology.orchestra.run.smithi187.stdout:ntpd: time slew +0.004365s
2023-04-11T16:12:18.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:18 ntpd[22435]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied
2023-04-11T16:12:18.174 INFO:teuthology.orchestra.run.smithi187.stderr:11 Apr 16:12:18 ntpd[22435]: can't open /var/log/ntpstats/loopstats.20230411: Permission denied
2023-04-11T16:12:18.200 INFO:teuthology.orchestra.run.smithi159.stdout:     remote           refid      st t when poll reach   delay   offset  jitter
2023-04-11T16:12:18.200 INFO:teuthology.orchestra.run.smithi159.stdout:==============================================================================
2023-04-11T16:12:18.201 INFO:teuthology.orchestra.run.smithi159.stdout: hv01.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2023-04-11T16:12:18.201 INFO:teuthology.orchestra.run.smithi159.stdout: hv02.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2023-04-11T16:12:18.201 INFO:teuthology.orchestra.run.smithi159.stdout: hv03.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2023-04-11T16:12:18.201 INFO:teuthology.orchestra.run.smithi159.stdout: hv04.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2023-04-11T16:12:18.224 INFO:teuthology.orchestra.run.smithi187.stdout:     remote           refid      st t when poll reach   delay   offset  jitter
2023-04-11T16:12:18.225 INFO:teuthology.orchestra.run.smithi187.stdout:==============================================================================
2023-04-11T16:12:18.225 INFO:teuthology.orchestra.run.smithi187.stdout: hv01.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2023-04-11T16:12:18.225 INFO:teuthology.orchestra.run.smithi187.stdout: hv02.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2023-04-11T16:12:18.225 INFO:teuthology.orchestra.run.smithi187.stdout: hv03.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2023-04-11T16:12:18.225 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT.          16 u    -   64    0    0.000    0.000   0.000
2023-04-11T16:12:18.226 INFO:teuthology.run_tasks:Running task nvme_loop...
2023-04-11T16:12:18.237 INFO:tasks.nvme_loop:Setting up nvme_loop on scratch devices...
2023-04-11T16:12:18.238 DEBUG:teuthology.orchestra.run.smithi159:> set -ex
2023-04-11T16:12:18.238 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout
2023-04-11T16:12:18.244 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4']
2023-04-11T16:12:18.245 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1
2023-04-11T16:12:18.293 INFO:teuthology.orchestra.run.smithi159.stdout:  File: /dev/vg_nvme/lv_1 -> ../dm-0
2023-04-11T16:12:18.293 INFO:teuthology.orchestra.run.smithi159.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2023-04-11T16:12:18.293 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 6h/6d	Inode: 340         Links: 1
2023-04-11T16:12:18.293 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2023-04-11T16:12:18.294 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-04-11 16:10:38.789261261 +0000
2023-04-11T16:12:18.294 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-04-11 16:10:38.573264022 +0000
2023-04-11T16:12:18.294 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-04-11 16:10:38.573264022 +0000
2023-04-11T16:12:18.294 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: -
2023-04-11T16:12:18.294 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1
2023-04-11T16:12:18.348 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in
2023-04-11T16:12:18.348 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out
2023-04-11T16:12:18.348 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000406337 s, 1.3 MB/s
2023-04-11T16:12:18.349 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1
2023-04-11T16:12:18.398 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2
2023-04-11T16:12:18.445 INFO:teuthology.orchestra.run.smithi159.stdout:  File: /dev/vg_nvme/lv_2 -> ../dm-1
2023-04-11T16:12:18.445 INFO:teuthology.orchestra.run.smithi159.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2023-04-11T16:12:18.445 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 6h/6d	Inode: 347         Links: 1
2023-04-11T16:12:18.445 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2023-04-11T16:12:18.445 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-04-11 16:10:39.157256559 +0000
2023-04-11T16:12:18.446 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-04-11 16:10:38.933259422 +0000
2023-04-11T16:12:18.446 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-04-11 16:10:38.933259422 +0000
2023-04-11T16:12:18.446 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: -
2023-04-11T16:12:18.446 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1
2023-04-11T16:12:18.499 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in
2023-04-11T16:12:18.500 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out
2023-04-11T16:12:18.500 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000363952 s, 1.4 MB/s
2023-04-11T16:12:18.501 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2
2023-04-11T16:12:18.550 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3
2023-04-11T16:12:18.597 INFO:teuthology.orchestra.run.smithi159.stdout:  File: /dev/vg_nvme/lv_3 -> ../dm-2
2023-04-11T16:12:18.597 INFO:teuthology.orchestra.run.smithi159.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2023-04-11T16:12:18.597 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 6h/6d	Inode: 353         Links: 1
2023-04-11T16:12:18.597 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2023-04-11T16:12:18.597 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-04-11 16:10:39.505252111 +0000
2023-04-11T16:12:18.598 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-04-11 16:10:39.293254820 +0000
2023-04-11T16:12:18.598 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-04-11 16:10:39.293254820 +0000
2023-04-11T16:12:18.598 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: -
2023-04-11T16:12:18.598 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1
2023-04-11T16:12:18.651 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in
2023-04-11T16:12:18.652 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out
2023-04-11T16:12:18.652 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000352082 s, 1.5 MB/s
2023-04-11T16:12:18.652 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3
2023-04-11T16:12:18.702 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4
2023-04-11T16:12:18.749 INFO:teuthology.orchestra.run.smithi159.stdout:  File: /dev/vg_nvme/lv_4 -> ../dm-3
2023-04-11T16:12:18.749 INFO:teuthology.orchestra.run.smithi159.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2023-04-11T16:12:18.749 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 6h/6d	Inode: 359         Links: 1
2023-04-11T16:12:18.749 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2023-04-11T16:12:18.749 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-04-11 16:10:39.881247307 +0000
2023-04-11T16:12:18.749 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-04-11 16:10:39.661250117 +0000
2023-04-11T16:12:18.750 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-04-11 16:10:39.661250117 +0000
2023-04-11T16:12:18.750 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: -
2023-04-11T16:12:18.750 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1
2023-04-11T16:12:18.803 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in
2023-04-11T16:12:18.804 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out
2023-04-11T16:12:18.804 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000343991 s, 1.5 MB/s
2023-04-11T16:12:18.805 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4
2023-04-11T16:12:18.854 DEBUG:teuthology.orchestra.run.smithi159:> sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype
2023-04-11T16:12:18.967 INFO:teuthology.orchestra.run.smithi159.stdout:loop
2023-04-11T16:12:18.968 INFO:tasks.nvme_loop:Connecting nvme_loop smithi159:/dev/vg_nvme/lv_1...
2023-04-11T16:12:18.969 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn
2023-04-11T16:12:18.987 INFO:teuthology.orchestra.run.smithi159.stdout:1
2023-04-11T16:12:19.014 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/vg_nvme/lv_11
2023-04-11T16:12:19.031 INFO:tasks.nvme_loop:Connecting nvme_loop smithi159:/dev/vg_nvme/lv_2...
2023-04-11T16:12:19.032 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn
2023-04-11T16:12:19.095 INFO:teuthology.orchestra.run.smithi159.stdout:1
2023-04-11T16:12:19.122 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/vg_nvme/lv_21
2023-04-11T16:12:19.143 INFO:tasks.nvme_loop:Connecting nvme_loop smithi159:/dev/vg_nvme/lv_3...
2023-04-11T16:12:19.143 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn
2023-04-11T16:12:19.206 INFO:teuthology.orchestra.run.smithi159.stdout:1
2023-04-11T16:12:19.234 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/vg_nvme/lv_31
2023-04-11T16:12:19.251 INFO:tasks.nvme_loop:Connecting nvme_loop smithi159:/dev/vg_nvme/lv_4...
2023-04-11T16:12:19.252 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn
2023-04-11T16:12:19.315 INFO:teuthology.orchestra.run.smithi159.stdout:1
2023-04-11T16:12:19.342 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/vg_nvme/lv_41
2023-04-11T16:12:19.364 DEBUG:teuthology.orchestra.run.smithi159:> set -ex
2023-04-11T16:12:19.364 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout
2023-04-11T16:12:19.412 DEBUG:teuthology.orchestra.run.smithi159:> sudo nvme list
2023-04-11T16:12:19.466 INFO:teuthology.orchestra.run.smithi159.stdout:Node             SN                   Model                                    Namespace Usage                      Format           FW Rev
2023-04-11T16:12:19.467 INFO:teuthology.orchestra.run.smithi159.stdout:---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- --------
2023-04-11T16:12:19.467 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/nvme0n1     CVFT623300GH400BGN   INTEL SSDPEDMD400G4                      1         400.09  GB / 400.09  GB    512   B +  0 B   8DV101H0
2023-04-11T16:12:19.467 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/nvme1n1     73cb41672cf845fa     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2023-04-11T16:12:19.467 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/nvme2n1     c03847e5638b0a5b     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2023-04-11T16:12:19.467 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/nvme3n1     8e201a2811ce9a1d     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2023-04-11T16:12:19.467 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/nvme4n1     77d7f077cbba2156     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2023-04-11T16:12:19.468 INFO:tasks.nvme_loop:new_devs ['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1']
2023-04-11T16:12:19.468 DEBUG:teuthology.orchestra.run.smithi159:> set -ex
2023-04-11T16:12:19.468 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/scratch_devs
2023-04-11T16:12:19.524 DEBUG:teuthology.orchestra.run.smithi187:> set -ex
2023-04-11T16:12:19.524 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout
2023-04-11T16:12:19.531 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4']
2023-04-11T16:12:19.531 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1
2023-04-11T16:12:19.580 INFO:teuthology.orchestra.run.smithi187.stdout:  File: /dev/vg_nvme/lv_1 -> ../dm-0
2023-04-11T16:12:19.580 INFO:teuthology.orchestra.run.smithi187.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2023-04-11T16:12:19.580 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d	Inode: 338         Links: 1
2023-04-11T16:12:19.581 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2023-04-11T16:12:19.581 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-04-11 16:10:47.399100576 +0000
2023-04-11T16:12:19.581 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-04-11 16:10:47.179108671 +0000
2023-04-11T16:12:19.581 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-04-11 16:10:47.179108671 +0000
2023-04-11T16:12:19.581 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: -
2023-04-11T16:12:19.581 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1
2023-04-11T16:12:19.635 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in
2023-04-11T16:12:19.635 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out
2023-04-11T16:12:19.635 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000379712 s, 1.3 MB/s
2023-04-11T16:12:19.636 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1
2023-04-11T16:12:19.685 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2
2023-04-11T16:12:19.732 INFO:teuthology.orchestra.run.smithi187.stdout:  File: /dev/vg_nvme/lv_2 -> ../dm-1
2023-04-11T16:12:19.732 INFO:teuthology.orchestra.run.smithi187.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2023-04-11T16:12:19.732 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d	Inode: 345         Links: 1
2023-04-11T16:12:19.733 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2023-04-11T16:12:19.733 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-04-11 16:10:47.759087329 +0000
2023-04-11T16:12:19.733 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-04-11 16:10:47.543095277 +0000
2023-04-11T16:12:19.733 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-04-11 16:10:47.543095277 +0000
2023-04-11T16:12:19.733 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: -
2023-04-11T16:12:19.733 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1
2023-04-11T16:12:19.787 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in
2023-04-11T16:12:19.787 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out
2023-04-11T16:12:19.787 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000370023 s, 1.4 MB/s
2023-04-11T16:12:19.788 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2
2023-04-11T16:12:19.837 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3
2023-04-11T16:12:19.884 INFO:teuthology.orchestra.run.smithi187.stdout:  File: /dev/vg_nvme/lv_3 -> ../dm-2
2023-04-11T16:12:19.884 INFO:teuthology.orchestra.run.smithi187.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2023-04-11T16:12:19.884 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d	Inode: 351         Links: 1
2023-04-11T16:12:19.884 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2023-04-11T16:12:19.884 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-04-11 16:10:48.111074377 +0000
2023-04-11T16:12:19.885 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-04-11 16:10:47.895082325 +0000
2023-04-11T16:12:19.885 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-04-11 16:10:47.895082325 +0000
2023-04-11T16:12:19.885 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: -
2023-04-11T16:12:19.885 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1
2023-04-11T16:12:19.939 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in
2023-04-11T16:12:19.939 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out
2023-04-11T16:12:19.939 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000296748 s, 1.7 MB/s
2023-04-11T16:12:19.940 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3
2023-04-11T16:12:19.989 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4
2023-04-11T16:12:20.036 INFO:teuthology.orchestra.run.smithi187.stdout:  File: /dev/vg_nvme/lv_4 -> ../dm-3
2023-04-11T16:12:20.036 INFO:teuthology.orchestra.run.smithi187.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2023-04-11T16:12:20.036 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d	Inode: 357         Links: 1
2023-04-11T16:12:20.036 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2023-04-11T16:12:20.036 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-04-11 16:10:48.475060983 +0000
2023-04-11T16:12:20.037 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-04-11 16:10:48.259068932 +0000
2023-04-11T16:12:20.037 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-04-11 16:10:48.259068932 +0000
2023-04-11T16:12:20.037 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: -
2023-04-11T16:12:20.037 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1
2023-04-11T16:12:20.090 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in
2023-04-11T16:12:20.091 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out
2023-04-11T16:12:20.091 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000348723 s, 1.5 MB/s
2023-04-11T16:12:20.092 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4
2023-04-11T16:12:20.141 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype
2023-04-11T16:12:20.265 INFO:teuthology.orchestra.run.smithi187.stdout:loop
2023-04-11T16:12:20.266 INFO:tasks.nvme_loop:Connecting nvme_loop smithi187:/dev/vg_nvme/lv_1...
2023-04-11T16:12:20.267 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn
2023-04-11T16:12:20.286 INFO:teuthology.orchestra.run.smithi187.stdout:1
2023-04-11T16:12:20.312 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/vg_nvme/lv_11
2023-04-11T16:12:20.330 INFO:tasks.nvme_loop:Connecting nvme_loop smithi187:/dev/vg_nvme/lv_2...
2023-04-11T16:12:20.330 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn
2023-04-11T16:12:20.396 INFO:teuthology.orchestra.run.smithi187.stdout:1
2023-04-11T16:12:20.422 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/vg_nvme/lv_21
2023-04-11T16:12:20.442 INFO:tasks.nvme_loop:Connecting nvme_loop smithi187:/dev/vg_nvme/lv_3...
2023-04-11T16:12:20.443 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn
2023-04-11T16:12:20.508 INFO:teuthology.orchestra.run.smithi187.stdout:1
2023-04-11T16:12:20.536 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/vg_nvme/lv_31
2023-04-11T16:12:20.559 INFO:tasks.nvme_loop:Connecting nvme_loop smithi187:/dev/vg_nvme/lv_4...
2023-04-11T16:12:20.559 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn
2023-04-11T16:12:20.622 INFO:teuthology.orchestra.run.smithi187.stdout:1
2023-04-11T16:12:20.651 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/vg_nvme/lv_41
2023-04-11T16:12:20.674 DEBUG:teuthology.orchestra.run.smithi187:> set -ex
2023-04-11T16:12:20.674 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout
2023-04-11T16:12:20.723 DEBUG:teuthology.orchestra.run.smithi187:> sudo nvme list
2023-04-11T16:12:20.779 INFO:teuthology.orchestra.run.smithi187.stdout:Node             SN                   Model                                    Namespace Usage                      Format           FW Rev
2023-04-11T16:12:20.779 INFO:teuthology.orchestra.run.smithi187.stdout:---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- --------
2023-04-11T16:12:20.779 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/nvme0n1     PHFT620500MW400BGN   INTEL SSDPEDMD400G4                      1         400.09  GB / 400.09  GB    512   B +  0 B   8DV101H0
2023-04-11T16:12:20.779 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/nvme1n1     59cf7faf1a07dbdf     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2023-04-11T16:12:20.779 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/nvme2n1     4a80dabcc8025433     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2023-04-11T16:12:20.779 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/nvme3n1     bd11db24fb15d709     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2023-04-11T16:12:20.779 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/nvme4n1     2fd5fd7d2f6b0c8c     Linux                                    1          96.00  GB /  96.00  GB    512   B +  0 B   4.15.0-2
2023-04-11T16:12:20.780 INFO:tasks.nvme_loop:new_devs ['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1']
2023-04-11T16:12:20.780 DEBUG:teuthology.orchestra.run.smithi187:> set -ex
2023-04-11T16:12:20.781 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/scratch_devs
2023-04-11T16:12:20.835 INFO:teuthology.run_tasks:Running task cephadm...
2023-04-11T16:12:20.910 INFO:tasks.cephadm:Config: {'roleless': True, 'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '7170c9b95054b834ac0ed4c3453ebc92157b37e3'}
2023-04-11T16:12:20.910 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7170c9b95054b834ac0ed4c3453ebc92157b37e3
2023-04-11T16:12:20.919 INFO:tasks.cephadm:Cluster fsid is a33a9244-d883-11ed-9aff-001a4aab830c
2023-04-11T16:12:20.920 INFO:tasks.cephadm:Choosing monitor IPs and ports...
2023-04-11T16:12:20.920 INFO:tasks.cephadm:No mon roles; fabricating mons
2023-04-11T16:12:20.921 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi159': '172.21.15.159', 'mon.smithi187': '172.21.15.187'}
2023-04-11T16:12:20.921 INFO:tasks.cephadm:Normalizing hostnames...
2023-04-11T16:12:20.921 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname $(hostname -s)
2023-04-11T16:12:20.938 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname $(hostname -s)
2023-04-11T16:12:20.954 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph-ci.git ref 7170c9b95054b834ac0ed4c3453ebc92157b37e3)...
2023-04-11T16:12:20.955 DEBUG:teuthology.orchestra.run.smithi159:> curl --silent https://raw.githubusercontent.com/ceph/ceph-ci/7170c9b95054b834ac0ed4c3453ebc92157b37e3/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm
2023-04-11T16:12:21.211 INFO:teuthology.orchestra.run.smithi159.stdout:-rw-rw-r-- 1 ubuntu ubuntu 346477 Apr 11 16:12 /home/ubuntu/cephtest/cephadm
2023-04-11T16:12:21.211 DEBUG:teuthology.orchestra.run.smithi187:> curl --silent https://raw.githubusercontent.com/ceph/ceph-ci/7170c9b95054b834ac0ed4c3453ebc92157b37e3/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm
2023-04-11T16:12:21.369 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-rw-r-- 1 ubuntu ubuntu 346477 Apr 11 16:12 /home/ubuntu/cephtest/cephadm
2023-04-11T16:12:21.370 DEBUG:teuthology.orchestra.run.smithi159:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm
2023-04-11T16:12:21.379 DEBUG:teuthology.orchestra.run.smithi187:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm
2023-04-11T16:12:21.394 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph
2023-04-11T16:12:21.436 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph
2023-04-11T16:12:21.451 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /etc/ceph
2023-04-11T16:12:21.491 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /etc/ceph
2023-04-11T16:12:21.507 INFO:tasks.cephadm:Writing seed config...
2023-04-11T16:12:21.508 INFO:tasks.cephadm: override: [mgr] debug mgr = 20
2023-04-11T16:12:21.508 INFO:tasks.cephadm: override: [mgr] debug ms = 1
2023-04-11T16:12:21.508 INFO:tasks.cephadm: override: [mon] debug mon = 20
2023-04-11T16:12:21.509 INFO:tasks.cephadm: override: [mon] debug ms = 1
2023-04-11T16:12:21.509 INFO:tasks.cephadm: override: [mon] debug paxos = 20
2023-04-11T16:12:21.509 INFO:tasks.cephadm: override: [osd] debug ms = 1
2023-04-11T16:12:21.509 INFO:tasks.cephadm: override: [osd] debug osd = 20
2023-04-11T16:12:21.509 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True
2023-04-11T16:12:21.510 DEBUG:teuthology.orchestra.run.smithi159:> set -ex
2023-04-11T16:12:21.510 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/seed.ceph.conf
2023-04-11T16:12:21.539 DEBUG:tasks.cephadm:Final config:
[global]
# make logging friendly to teuthology
log_to_file = true
log_to_stderr = false
mon cluster log file level = debug

mon clock drift allowed = 1.000

# replicate across OSDs, not hosts
osd crush chooseleaf type = 0
#osd pool default size = 2
osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd

# enable some debugging
auth debug = true
ms die on old message = true
ms die on bug = true
debug asserts on shutdown = true

# adjust warnings
mon max pg per osd = 10000# >= luminous
mon pg warn max object skew = 0
mon osd allow primary affinity = true
mon osd allow pg remap = true
mon warn on legacy crush tunables = false
mon warn on crush straw calc version zero = false
mon warn on no sortbitwise = false
mon warn on osd down out interval zero = false
mon warn on too few osds = false
mon_warn_on_pool_pg_num_not_power_of_two = false

# disable pg_autoscaler by default for new pools
osd_pool_default_pg_autoscale_mode = off

# tests delete pools
mon allow pool delete = true
fsid = a33a9244-d883-11ed-9aff-001a4aab830c

[osd]
osd scrub load threshold = 5.0
osd scrub max interval = 600

osd recover clone overlap = true
osd recovery max chunk = 1048576

osd deep scrub update digest min age = 30

osd map max advance = 10

osd memory target autotune = true

# debugging
osd debug shutdown = true
osd debug op order = true
osd debug verify stray on activate = true
osd debug pg log writeout = true
osd debug verify cached snaps = true
osd debug verify missing on start = true
osd debug misdirected ops = true
osd op queue = debug_random
osd op queue cut off = debug_random
osd shutdown pgref assert = True
bdev debug aio = true
osd sloppy crc = true
debug ms = 1
debug osd = 20

[mgr]
mon reweight min pgs per osd = 4
mon reweight min bytes per osd = 10
mgr/telemetry/nag = false
debug mgr = 20
debug ms = 1

[mon]
mon data avail warn = 5
mon mgr mkfs grace = 240
mon reweight min pgs per osd = 4
mon osd reporter subtree level = osd
mon osd prime pg temp = true
mon reweight min bytes per osd = 10

# rotate auth tickets quickly to exercise renewal paths
auth mon ticket ttl = 660# 11m
auth service ticket ttl = 240# 4m

# don't complain about global id reclaim
mon_warn_on_insecure_global_id_reclaim = false
mon_warn_on_insecure_global_id_reclaim_allowed = false
debug mon = 20
debug ms = 1
debug paxos = 20

[client.rgw]
rgw cache enabled = true
rgw enable ops log = true
rgw enable usage log = true

2023-04-11T16:12:21.539 DEBUG:teuthology.orchestra.run.smithi159:mon.smithi159> sudo journalctl -f -n 0 -u ceph-a33a9244-d883-11ed-9aff-001a4aab830c@mon.smithi159.service
2023-04-11T16:12:21.583 INFO:tasks.cephadm:Bootstrapping...
2023-04-11T16:12:21.583 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7170c9b95054b834ac0ed4c3453ebc92157b37e3 -v bootstrap --fsid a33a9244-d883-11ed-9aff-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.159 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring
2023-04-11T16:12:21.920 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:-- Logs begin at Sun 2022-10-16 12:17:23 UTC. --
2023-04-11T16:12:22.093 INFO:teuthology.orchestra.run.smithi159.stderr:--------------------------------------------------------------------------------
2023-04-11T16:12:22.094 INFO:teuthology.orchestra.run.smithi159.stderr:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7170c9b95054b834ac0ed4c3453ebc92157b37e3', '-v', 'bootstrap', '--fsid', 'a33a9244-d883-11ed-9aff-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.159', '--skip-admin-label']
2023-04-11T16:12:22.094 INFO:teuthology.orchestra.run.smithi159.stderr:Verifying podman|docker is present...
2023-04-11T16:12:22.094 INFO:teuthology.orchestra.run.smithi159.stderr:Verifying lvm2 is present...
2023-04-11T16:12:22.094 INFO:teuthology.orchestra.run.smithi159.stderr:Verifying time synchronization is in place...
2023-04-11T16:12:22.100 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory
2023-04-11T16:12:22.109 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: inactive
2023-04-11T16:12:22.117 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: Failed to get unit file state for chronyd.service: No such file or directory
2023-04-11T16:12:22.126 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: inactive
2023-04-11T16:12:22.135 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: enabled
2023-04-11T16:12:22.143 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: inactive
2023-04-11T16:12:22.152 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: Failed to get unit file state for ntpd.service: No such file or directory
2023-04-11T16:12:22.159 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: inactive
2023-04-11T16:12:22.168 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: enabled
2023-04-11T16:12:22.176 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: active
2023-04-11T16:12:22.177 INFO:teuthology.orchestra.run.smithi159.stderr:Unit ntp.service is enabled and running
2023-04-11T16:12:22.177 INFO:teuthology.orchestra.run.smithi159.stderr:Repeating the final host check...
2023-04-11T16:12:22.177 INFO:teuthology.orchestra.run.smithi159.stderr:docker (/usr/bin/docker) is present
2023-04-11T16:12:22.178 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl is present
2023-04-11T16:12:22.178 INFO:teuthology.orchestra.run.smithi159.stderr:lvcreate is present
2023-04-11T16:12:22.183 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory
2023-04-11T16:12:22.190 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: inactive
2023-04-11T16:12:22.198 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: Failed to get unit file state for chronyd.service: No such file or directory
2023-04-11T16:12:22.206 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: inactive
2023-04-11T16:12:22.215 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: enabled
2023-04-11T16:12:22.223 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: inactive
2023-04-11T16:12:22.231 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: Failed to get unit file state for ntpd.service: No such file or directory
2023-04-11T16:12:22.239 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: inactive
2023-04-11T16:12:22.249 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: enabled
2023-04-11T16:12:22.258 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: active
2023-04-11T16:12:22.259 INFO:teuthology.orchestra.run.smithi159.stderr:Unit ntp.service is enabled and running
2023-04-11T16:12:22.259 INFO:teuthology.orchestra.run.smithi159.stderr:Host looks OK
2023-04-11T16:12:22.260 INFO:teuthology.orchestra.run.smithi159.stderr:Cluster fsid: a33a9244-d883-11ed-9aff-001a4aab830c
2023-04-11T16:12:22.261 INFO:teuthology.orchestra.run.smithi159.stderr:Acquiring lock 139721720677656 on /run/cephadm/a33a9244-d883-11ed-9aff-001a4aab830c.lock
2023-04-11T16:12:22.261 INFO:teuthology.orchestra.run.smithi159.stderr:Lock 139721720677656 acquired on /run/cephadm/a33a9244-d883-11ed-9aff-001a4aab830c.lock
2023-04-11T16:12:22.261 INFO:teuthology.orchestra.run.smithi159.stderr:Verifying IP 172.21.15.159 port 3300 ...
2023-04-11T16:12:22.262 INFO:teuthology.orchestra.run.smithi159.stderr:Verifying IP 172.21.15.159 port 6789 ...
2023-04-11T16:12:22.262 INFO:teuthology.orchestra.run.smithi159.stderr:Base mon IP(s) is [172.21.15.159:3300, 172.21.15.159:6789], mon addrv is [v2:172.21.15.159:3300,v1:172.21.15.159:6789]
2023-04-11T16:12:22.266 INFO:teuthology.orchestra.run.smithi159.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1
2023-04-11T16:12:22.266 INFO:teuthology.orchestra.run.smithi159.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.159 metric 100
2023-04-11T16:12:22.266 INFO:teuthology.orchestra.run.smithi159.stderr:/sbin/ip: 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown
2023-04-11T16:12:22.266 INFO:teuthology.orchestra.run.smithi159.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.159
2023-04-11T16:12:22.267 INFO:teuthology.orchestra.run.smithi159.stderr:/sbin/ip: 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.159 metric 100
2023-04-11T16:12:22.270 INFO:teuthology.orchestra.run.smithi159.stderr:/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium
2023-04-11T16:12:22.270 INFO:teuthology.orchestra.run.smithi159.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium
2023-04-11T16:12:22.274 INFO:teuthology.orchestra.run.smithi159.stderr:/sbin/ip: 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 state UNKNOWN qlen 1000
2023-04-11T16:12:22.274 INFO:teuthology.orchestra.run.smithi159.stderr:/sbin/ip:     inet6 ::1/128 scope host
2023-04-11T16:12:22.275 INFO:teuthology.orchestra.run.smithi159.stderr:/sbin/ip:        valid_lft forever preferred_lft forever
2023-04-11T16:12:22.275 INFO:teuthology.orchestra.run.smithi159.stderr:/sbin/ip: 5: enp3s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 state UP qlen 1000
2023-04-11T16:12:22.275 INFO:teuthology.orchestra.run.smithi159.stderr:/sbin/ip:     inet6 fe80::ec4:7aff:fe88:724f/64 scope link
2023-04-11T16:12:22.275 INFO:teuthology.orchestra.run.smithi159.stderr:/sbin/ip:        valid_lft forever preferred_lft forever
2023-04-11T16:12:22.276 INFO:teuthology.orchestra.run.smithi159.stderr:Mon IP `172.21.15.159` is in CIDR network `172.21.0.0/20`
2023-04-11T16:12:22.277 INFO:teuthology.orchestra.run.smithi159.stderr:Mon IP `172.21.15.159` is in CIDR network `172.21.0.0/20`
2023-04-11T16:12:22.277 INFO:teuthology.orchestra.run.smithi159.stderr:Mon IP `172.21.15.159` is in CIDR network `172.21.15.254/32`
2023-04-11T16:12:22.277 INFO:teuthology.orchestra.run.smithi159.stderr:Mon IP `172.21.15.159` is in CIDR network `172.21.15.254/32`
2023-04-11T16:12:22.278 INFO:teuthology.orchestra.run.smithi159.stderr:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20', '172.21.15.254/32', '172.21.15.254/32']
2023-04-11T16:12:22.278 INFO:teuthology.orchestra.run.smithi159.stderr:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network
2023-04-11T16:12:22.279 INFO:teuthology.orchestra.run.smithi159.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7170c9b95054b834ac0ed4c3453ebc92157b37e3...
2023-04-11T16:12:22.659 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/docker: 7170c9b95054b834ac0ed4c3453ebc92157b37e3: Pulling from ceph-ci/ceph
2023-04-11T16:12:22.665 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/docker: e8273662897a: Pulling fs layer
2023-04-11T16:12:22.665 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/docker: 95c29e3a21b9: Pulling fs layer
2023-04-11T16:12:23.368 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/docker: e8273662897a: Verifying Checksum
2023-04-11T16:12:23.369 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/docker: e8273662897a: Download complete
2023-04-11T16:12:24.861 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/docker: 95c29e3a21b9: Verifying Checksum
2023-04-11T16:12:24.862 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/docker: 95c29e3a21b9: Download complete
2023-04-11T16:12:25.901 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/docker: e8273662897a: Pull complete
2023-04-11T16:12:34.928 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/docker: 95c29e3a21b9: Pull complete
2023-04-11T16:12:35.107 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/docker: Digest: sha256:3038bce941de21d3a8d99ebe297c9835ef11aa96c7c2f96a375d212129f27fc2
2023-04-11T16:12:35.154 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/docker: Status: Downloaded newer image for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7170c9b95054b834ac0ed4c3453ebc92157b37e3
2023-04-11T16:12:35.190 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/docker: quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7170c9b95054b834ac0ed4c3453ebc92157b37e3
2023-04-11T16:12:44.306 INFO:teuthology.orchestra.run.smithi159.stderr:ceph: ceph version 16.2.11-391-g7170c9b9 (7170c9b95054b834ac0ed4c3453ebc92157b37e3) pacific (stable)
2023-04-11T16:12:44.805 INFO:teuthology.orchestra.run.smithi159.stderr:Ceph version: ceph version 16.2.11-391-g7170c9b9 (7170c9b95054b834ac0ed4c3453ebc92157b37e3) pacific (stable)
2023-04-11T16:12:44.805 INFO:teuthology.orchestra.run.smithi159.stderr:Extracting ceph user uid/gid from container image...
2023-04-11T16:12:45.617 INFO:teuthology.orchestra.run.smithi159.stderr:stat: 167 167
2023-04-11T16:12:46.117 INFO:teuthology.orchestra.run.smithi159.stderr:Creating initial keys...
2023-04-11T16:12:46.941 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-authtool: AQD+hjVkcDJTOBAASNc2q6yg4SxbjeQJ0TK3qQ==
2023-04-11T16:12:48.316 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-authtool: AQAAhzVkLMwMExAASgk+tWSkxlT6UQWmCtEQdQ==
2023-04-11T16:12:49.674 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-authtool: AQABhzVkzchpKBAAXvCf0Z2ZawTXBXJdrTdppQ==
2023-04-11T16:12:50.107 INFO:teuthology.orchestra.run.smithi159.stderr:Creating initial monmap...
2023-04-11T16:12:51.008 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap
2023-04-11T16:12:51.008 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to a33a9244-d883-11ed-9aff-001a4aab830c
2023-04-11T16:12:51.008 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors)
2023-04-11T16:12:51.529 INFO:teuthology.orchestra.run.smithi159.stderr:monmaptool for smithi159 [v2:172.21.15.159:3300,v1:172.21.15.159:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap
2023-04-11T16:12:51.529 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/monmaptool: set fsid to a33a9244-d883-11ed-9aff-001a4aab830c
2023-04-11T16:12:51.529 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors)
2023-04-11T16:12:51.530 INFO:teuthology.orchestra.run.smithi159.stderr:
2023-04-11T16:12:51.530 INFO:teuthology.orchestra.run.smithi159.stderr:Creating mon...
2023-04-11T16:12:52.412 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.411+0000 7f59db558880  0 set uid:gid to 167:167 (ceph:ceph)
2023-04-11T16:12:52.412 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.411+0000 7f59db558880  1 imported monmap:
2023-04-11T16:12:52.412 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: epoch 0
2023-04-11T16:12:52.413 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: fsid a33a9244-d883-11ed-9aff-001a4aab830c
2023-04-11T16:12:52.414 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: last_changed 2023-04-11T16:12:51.011570+0000
2023-04-11T16:12:52.414 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: created 2023-04-11T16:12:51.011570+0000
2023-04-11T16:12:52.414 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown)
2023-04-11T16:12:52.414 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: election_strategy: 1
2023-04-11T16:12:52.414 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.smithi159
2023-04-11T16:12:52.414 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.415 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.411+0000 7f59db558880  0 /usr/bin/ceph-mon: set fsid to a33a9244-d883-11ed-9aff-001a4aab830c
2023-04-11T16:12:52.416 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: RocksDB version: 6.8.1
2023-04-11T16:12:52.416 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.416 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Git sha rocksdb_build_git_sha:@0@
2023-04-11T16:12:52.416 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Compile date Apr  6 2023
2023-04-11T16:12:52.416 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: DB SUMMARY
2023-04-11T16:12:52.417 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.417 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi159/store.db dir, Total Num: 0, files:
2023-04-11T16:12:52.417 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.417 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi159/store.db:
2023-04-11T16:12:52.417 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.417 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                         Options.error_if_exists: 0
2023-04-11T16:12:52.417 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                       Options.create_if_missing: 1
2023-04-11T16:12:52.418 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                         Options.paranoid_checks: 1
2023-04-11T16:12:52.418 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                                     Options.env: 0x56096b97f080
2023-04-11T16:12:52.420 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                                      Options.fs: Posix File System
2023-04-11T16:12:52.420 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                                Options.info_log: 0x56096dda52e0
2023-04-11T16:12:52.420 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                Options.max_file_opening_threads: 16
2023-04-11T16:12:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                              Options.statistics: (nil)
2023-04-11T16:12:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                               Options.use_fsync: 0
2023-04-11T16:12:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                       Options.max_log_file_size: 0
2023-04-11T16:12:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                  Options.max_manifest_file_size: 1073741824
2023-04-11T16:12:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                   Options.log_file_time_to_roll: 0
2023-04-11T16:12:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                       Options.keep_log_file_num: 1000
2023-04-11T16:12:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                    Options.recycle_log_file_num: 0
2023-04-11T16:12:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                         Options.allow_fallocate: 1
2023-04-11T16:12:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                        Options.allow_mmap_reads: 0
2023-04-11T16:12:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                       Options.allow_mmap_writes: 0
2023-04-11T16:12:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                        Options.use_direct_reads: 0
2023-04-11T16:12:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                        Options.use_direct_io_for_flush_and_compaction: 0
2023-04-11T16:12:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:          Options.create_missing_column_families: 0
2023-04-11T16:12:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                              Options.db_log_dir:
2023-04-11T16:12:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                                 Options.wal_dir: /var/lib/ceph/mon/ceph-smithi159/store.db
2023-04-11T16:12:52.423 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                Options.table_cache_numshardbits: 6
2023-04-11T16:12:52.423 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                      Options.max_subcompactions: 1
2023-04-11T16:12:52.423 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                  Options.max_background_flushes: -1
2023-04-11T16:12:52.423 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                         Options.WAL_ttl_seconds: 0
2023-04-11T16:12:52.423 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                       Options.WAL_size_limit_MB: 0
2023-04-11T16:12:52.423 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                        Options.max_write_batch_group_size_bytes: 1048576
2023-04-11T16:12:52.423 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.manifest_preallocation_size: 4194304
2023-04-11T16:12:52.424 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                     Options.is_fd_close_on_exec: 1
2023-04-11T16:12:52.424 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                   Options.advise_random_on_open: 1
2023-04-11T16:12:52.424 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                    Options.db_write_buffer_size: 0
2023-04-11T16:12:52.424 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                    Options.write_buffer_manager: 0x56096ddad6b0
2023-04-11T16:12:52.424 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:         Options.access_hint_on_compaction_start: 1
2023-04-11T16:12:52.424 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:  Options.new_table_reader_for_compaction_inputs: 0
2023-04-11T16:12:52.424 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:           Options.random_access_max_buffer_size: 1048576
2023-04-11T16:12:52.424 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                      Options.use_adaptive_mutex: 0
2023-04-11T16:12:52.425 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                            Options.rate_limiter: (nil)
2023-04-11T16:12:52.425 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:     Options.sst_file_manager.rate_bytes_per_sec: 0
2023-04-11T16:12:52.425 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                       Options.wal_recovery_mode: 2
2023-04-11T16:12:52.425 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                  Options.enable_thread_tracking: 0
2023-04-11T16:12:52.439 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                  Options.enable_pipelined_write: 0
2023-04-11T16:12:52.439 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                  Options.unordered_write: 0
2023-04-11T16:12:52.439 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:         Options.allow_concurrent_memtable_write: 1
2023-04-11T16:12:52.440 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:      Options.enable_write_thread_adaptive_yield: 1
2023-04-11T16:12:52.440 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.write_thread_max_yield_usec: 100
2023-04-11T16:12:52.440 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:            Options.write_thread_slow_yield_usec: 3
2023-04-11T16:12:52.440 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                               Options.row_cache: None
2023-04-11T16:12:52.440 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                              Options.wal_filter: None
2023-04-11T16:12:52.440 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.avoid_flush_during_recovery: 0
2023-04-11T16:12:52.440 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.allow_ingest_behind: 0
2023-04-11T16:12:52.441 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.preserve_deletes: 0
2023-04-11T16:12:52.441 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.two_write_queues: 0
2023-04-11T16:12:52.441 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.manual_wal_flush: 0
2023-04-11T16:12:52.441 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.atomic_flush: 0
2023-04-11T16:12:52.441 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.avoid_unnecessary_blocking_io: 0
2023-04-11T16:12:52.441 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                 Options.persist_stats_to_disk: 0
2023-04-11T16:12:52.441 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                 Options.write_dbid_to_manifest: 0
2023-04-11T16:12:52.441 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                 Options.log_readahead_size: 0
2023-04-11T16:12:52.442 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                 Options.sst_file_checksum_func: Unknown
2023-04-11T16:12:52.442 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.max_background_jobs: 2
2023-04-11T16:12:52.442 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.max_background_compactions: -1
2023-04-11T16:12:52.442 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.avoid_flush_during_shutdown: 0
2023-04-11T16:12:52.442 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:           Options.writable_file_max_buffer_size: 1048576
2023-04-11T16:12:52.442 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.delayed_write_rate : 16777216
2023-04-11T16:12:52.442 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.max_total_wal_size: 0
2023-04-11T16:12:52.443 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.delete_obsolete_files_period_micros: 21600000000
2023-04-11T16:12:52.443 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                   Options.stats_dump_period_sec: 600
2023-04-11T16:12:52.443 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                 Options.stats_persist_period_sec: 600
2023-04-11T16:12:52.443 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                 Options.stats_history_buffer_size: 1048576
2023-04-11T16:12:52.443 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                          Options.max_open_files: -1
2023-04-11T16:12:52.443 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                          Options.bytes_per_sync: 0
2023-04-11T16:12:52.443 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                      Options.wal_bytes_per_sync: 0
2023-04-11T16:12:52.443 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                   Options.strict_bytes_per_sync: 0
2023-04-11T16:12:52.444 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:       Options.compaction_readahead_size: 0
2023-04-11T16:12:52.444 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Compression algorithms supported:
2023-04-11T16:12:52.444 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: 	kZSTDNotFinalCompression supported: 0
2023-04-11T16:12:52.444 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: 	kZSTD supported: 0
2023-04-11T16:12:52.444 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: 	kXpressCompression supported: 0
2023-04-11T16:12:52.444 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: 	kLZ4HCCompression supported: 1
2023-04-11T16:12:52.444 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: 	kLZ4Compression supported: 1
2023-04-11T16:12:52.444 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: 	kBZip2Compression supported: 0
2023-04-11T16:12:52.445 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: 	kZlibCompression supported: 1
2023-04-11T16:12:52.445 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: 	kSnappyCompression supported: 1
2023-04-11T16:12:52.445 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Fast CRC32 supported: Supported on x86
2023-04-11T16:12:52.445 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1
2023-04-11T16:12:52.445 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.445 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000001
2023-04-11T16:12:52.445 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.445 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]:
2023-04-11T16:12:52.446 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.446 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:               Options.comparator: leveldb.BytewiseComparator
2023-04-11T16:12:52.446 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:           Options.merge_operator:
2023-04-11T16:12:52.446 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:        Options.compaction_filter: None
2023-04-11T16:12:52.446 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:        Options.compaction_filter_factory: None
2023-04-11T16:12:52.446 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:         Options.memtable_factory: SkipListFactory
2023-04-11T16:12:52.446 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:            Options.table_factory: BlockBasedTable
2023-04-11T16:12:52.446 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56096dcbbd18)
2023-04-11T16:12:52.447 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   cache_index_and_filter_blocks: 1
2023-04-11T16:12:52.447 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   cache_index_and_filter_blocks_with_high_priority: 0
2023-04-11T16:12:52.447 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   pin_l0_filter_and_index_blocks_in_cache: 0
2023-04-11T16:12:52.447 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   pin_top_level_index_and_filter: 1
2023-04-11T16:12:52.447 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   index_type: 0
2023-04-11T16:12:52.447 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   data_block_index_type: 0
2023-04-11T16:12:52.447 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   index_shortening: 1
2023-04-11T16:12:52.447 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   data_block_hash_table_util_ratio: 0.750000
2023-04-11T16:12:52.448 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   hash_index_allow_collision: 1
2023-04-11T16:12:52.448 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   checksum: 1
2023-04-11T16:12:52.448 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   no_block_cache: 0
2023-04-11T16:12:52.448 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   block_cache: 0x56096dcf2d10
2023-04-11T16:12:52.448 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   block_cache_name: BinnedLRUCache
2023-04-11T16:12:52.448 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   block_cache_options:
2023-04-11T16:12:52.448 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:     capacity : 536870912
2023-04-11T16:12:52.448 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:     num_shard_bits : 4
2023-04-11T16:12:52.449 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:     strict_capacity_limit : 0
2023-04-11T16:12:52.449 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:     high_pri_pool_ratio: 0.000
2023-04-11T16:12:52.449 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   block_cache_compressed: (nil)
2023-04-11T16:12:52.449 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   persistent_cache: (nil)
2023-04-11T16:12:52.449 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   block_size: 4096
2023-04-11T16:12:52.449 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   block_size_deviation: 10
2023-04-11T16:12:52.449 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   block_restart_interval: 16
2023-04-11T16:12:52.449 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   index_block_restart_interval: 1
2023-04-11T16:12:52.450 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   metadata_block_size: 4096
2023-04-11T16:12:52.450 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   partition_filters: 0
2023-04-11T16:12:52.450 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   use_delta_encoding: 1
2023-04-11T16:12:52.450 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   filter_policy: rocksdb.BuiltinBloomFilter
2023-04-11T16:12:52.450 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   whole_key_filtering: 1
2023-04-11T16:12:52.450 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   verify_compression: 0
2023-04-11T16:12:52.450 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   read_amp_bytes_per_bit: 0
2023-04-11T16:12:52.450 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   format_version: 2
2023-04-11T16:12:52.451 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   enable_index_compression: 1
2023-04-11T16:12:52.451 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:   block_align: 0
2023-04-11T16:12:52.451 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.451 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:        Options.write_buffer_size: 33554432
2023-04-11T16:12:52.451 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:  Options.max_write_buffer_number: 2
2023-04-11T16:12:52.451 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:          Options.compression: NoCompression
2023-04-11T16:12:52.451 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                  Options.bottommost_compression: Disabled
2023-04-11T16:12:52.451 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:       Options.prefix_extractor: nullptr
2023-04-11T16:12:52.452 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:   Options.memtable_insert_with_hint_prefix_extractor: nullptr
2023-04-11T16:12:52.452 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.num_levels: 7
2023-04-11T16:12:52.452 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:        Options.min_write_buffer_number_to_merge: 1
2023-04-11T16:12:52.452 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:     Options.max_write_buffer_number_to_maintain: 0
2023-04-11T16:12:52.452 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:     Options.max_write_buffer_size_to_maintain: 0
2023-04-11T16:12:52.452 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:            Options.bottommost_compression_opts.window_bits: -14
2023-04-11T16:12:52.452 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                  Options.bottommost_compression_opts.level: 32767
2023-04-11T16:12:52.452 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:               Options.bottommost_compression_opts.strategy: 0
2023-04-11T16:12:52.453 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:         Options.bottommost_compression_opts.max_dict_bytes: 0
2023-04-11T16:12:52.453 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:         Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2023-04-11T16:12:52.453 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                  Options.bottommost_compression_opts.enabled: false
2023-04-11T16:12:52.453 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:            Options.compression_opts.window_bits: -14
2023-04-11T16:12:52.453 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                  Options.compression_opts.level: 32767
2023-04-11T16:12:52.453 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:               Options.compression_opts.strategy: 0
2023-04-11T16:12:52.453 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:         Options.compression_opts.max_dict_bytes: 0
2023-04-11T16:12:52.454 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:         Options.compression_opts.zstd_max_train_bytes: 0
2023-04-11T16:12:52.454 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                  Options.compression_opts.enabled: false
2023-04-11T16:12:52.454 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:      Options.level0_file_num_compaction_trigger: 4
2023-04-11T16:12:52.454 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:          Options.level0_slowdown_writes_trigger: 20
2023-04-11T16:12:52.454 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:              Options.level0_stop_writes_trigger: 36
2023-04-11T16:12:52.454 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                   Options.target_file_size_base: 67108864
2023-04-11T16:12:52.454 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:             Options.target_file_size_multiplier: 1
2023-04-11T16:12:52.454 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                Options.max_bytes_for_level_base: 268435456
2023-04-11T16:12:52.455 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1
2023-04-11T16:12:52.455 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:          Options.max_bytes_for_level_multiplier: 10.000000
2023-04-11T16:12:52.455 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
2023-04-11T16:12:52.455 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
2023-04-11T16:12:52.455 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
2023-04-11T16:12:52.455 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
2023-04-11T16:12:52.455 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
2023-04-11T16:12:52.455 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
2023-04-11T16:12:52.456 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
2023-04-11T16:12:52.456 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:       Options.max_sequential_skip_in_iterations: 8
2023-04-11T16:12:52.456 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                    Options.max_compaction_bytes: 1677721600
2023-04-11T16:12:52.456 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                        Options.arena_block_size: 4194304
2023-04-11T16:12:52.456 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:   Options.soft_pending_compaction_bytes_limit: 68719476736
2023-04-11T16:12:52.456 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:   Options.hard_pending_compaction_bytes_limit: 274877906944
2023-04-11T16:12:52.456 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:       Options.rate_limit_delay_max_milliseconds: 100
2023-04-11T16:12:52.456 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                Options.disable_auto_compactions: 0
2023-04-11T16:12:52.456 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                        Options.compaction_style: kCompactionStyleLevel
2023-04-11T16:12:52.457 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                          Options.compaction_pri: kMinOverlappingRatio
2023-04-11T16:12:52.457 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.compaction_options_universal.size_ratio: 1
2023-04-11T16:12:52.457 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
2023-04-11T16:12:52.457 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
2023-04-11T16:12:52.457 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
2023-04-11T16:12:52.457 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
2023-04-11T16:12:52.457 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2023-04-11T16:12:52.458 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
2023-04-11T16:12:52.458 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
2023-04-11T16:12:52.458 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                   Options.table_properties_collectors:
2023-04-11T16:12:52.458 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                   Options.inplace_update_support: 0
2023-04-11T16:12:52.458 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                 Options.inplace_update_num_locks: 10000
2023-04-11T16:12:52.458 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:               Options.memtable_prefix_bloom_size_ratio: 0.000000
2023-04-11T16:12:52.458 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:               Options.memtable_whole_key_filtering: 0
2023-04-11T16:12:52.458 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:   Options.memtable_huge_page_size: 0
2023-04-11T16:12:52.459 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                           Options.bloom_locality: 0
2023-04-11T16:12:52.459 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                    Options.max_successive_merges: 0
2023-04-11T16:12:52.459 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                Options.optimize_filters_for_hits: 0
2023-04-11T16:12:52.459 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                Options.paranoid_file_checks: 0
2023-04-11T16:12:52.459 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                Options.force_consistency_checks: 0
2023-04-11T16:12:52.459 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                Options.report_bg_io_stats: 0
2023-04-11T16:12:52.459 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:                               Options.ttl: 2592000
2023-04-11T16:12:52.459 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.415+0000 7f59db558880  4 rocksdb:          Options.periodic_compaction_seconds: 0
2023-04-11T16:12:52.460 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.419+0000 7f59db558880  4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
2023-04-11T16:12:52.460 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.460 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.419+0000 7f59db558880  4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0
2023-04-11T16:12:52.460 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.460 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.419+0000 7f59db558880  4 rocksdb: DB pointer 0x56096ddbb800
2023-04-11T16:12:52.460 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.419+0000 7f59c43e8700  4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS -------
2023-04-11T16:12:52.460 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.419+0000 7f59c43e8700  4 rocksdb: [db_impl/db_impl.cc:851]
2023-04-11T16:12:52.460 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: ** DB Stats **
2023-04-11T16:12:52.461 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval
2023-04-11T16:12:52.461 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
2023-04-11T16:12:52.461 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
2023-04-11T16:12:52.461 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
2023-04-11T16:12:52.461 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
2023-04-11T16:12:52.461 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
2023-04-11T16:12:52.461 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
2023-04-11T16:12:52.461 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.462 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] **
2023-04-11T16:12:52.462 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
2023-04-11T16:12:52.462 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
2023-04-11T16:12:52.462 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:  Sum      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
2023-04-11T16:12:52.462 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:  Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
2023-04-11T16:12:52.462 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.462 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] **
2023-04-11T16:12:52.462 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
2023-04-11T16:12:52.463 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
2023-04-11T16:12:52.463 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval
2023-04-11T16:12:52.463 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000
2023-04-11T16:12:52.463 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000
2023-04-11T16:12:52.463 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0
2023-04-11T16:12:52.463 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0
2023-04-11T16:12:52.463 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0
2023-04-11T16:12:52.463 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
2023-04-11T16:12:52.464 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
2023-04-11T16:12:52.464 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
2023-04-11T16:12:52.464 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.464 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] **
2023-04-11T16:12:52.464 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.464 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] **
2023-04-11T16:12:52.464 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
2023-04-11T16:12:52.465 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
2023-04-11T16:12:52.465 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:  Sum      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
2023-04-11T16:12:52.465 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:  Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
2023-04-11T16:12:52.465 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.465 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] **
2023-04-11T16:12:52.465 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
2023-04-11T16:12:52.465 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
2023-04-11T16:12:52.465 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval
2023-04-11T16:12:52.466 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000
2023-04-11T16:12:52.466 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000
2023-04-11T16:12:52.466 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0
2023-04-11T16:12:52.466 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0
2023-04-11T16:12:52.466 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0
2023-04-11T16:12:52.466 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
2023-04-11T16:12:52.466 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
2023-04-11T16:12:52.466 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
2023-04-11T16:12:52.467 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.467 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] **
2023-04-11T16:12:52.467 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon:
2023-04-11T16:12:52.467 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.423+0000 7f59db558880  4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work
2023-04-11T16:12:52.467 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.423+0000 7f59db558880  4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete
2023-04-11T16:12:52.467 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph-mon: debug 2023-04-11T16:12:52.423+0000 7f59db558880  0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi159 for mon.smithi159
2023-04-11T16:12:52.899 INFO:teuthology.orchestra.run.smithi159.stderr:create mon.smithi159 on
2023-04-11T16:12:53.025 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target.
2023-04-11T16:12:53.160 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a33a9244-d883-11ed-9aff-001a4aab830c.target -> /etc/systemd/system/ceph-a33a9244-d883-11ed-9aff-001a4aab830c.target.
2023-04-11T16:12:53.161 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-a33a9244-d883-11ed-9aff-001a4aab830c.target -> /etc/systemd/system/ceph-a33a9244-d883-11ed-9aff-001a4aab830c.target.
2023-04-11T16:12:53.421 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: Failed to reset failed state of unit ceph-a33a9244-d883-11ed-9aff-001a4aab830c@mon.smithi159.service: Unit ceph-a33a9244-d883-11ed-9aff-001a4aab830c@mon.smithi159.service is not loaded.
2023-04-11T16:12:53.430 INFO:teuthology.orchestra.run.smithi159.stderr:systemctl: Created symlink /etc/systemd/system/ceph-a33a9244-d883-11ed-9aff-001a4aab830c.target.wants/ceph-a33a9244-d883-11ed-9aff-001a4aab830c@mon.smithi159.service -> /etc/systemd/system/ceph-a33a9244-d883-11ed-9aff-001a4aab830c@.service.
2023-04-11T16:12:53.557 INFO:teuthology.orchestra.run.smithi159.stderr:firewalld does not appear to be present
2023-04-11T16:12:53.557 INFO:teuthology.orchestra.run.smithi159.stderr:Not possible to enable service <mon>. firewalld.service is not available
2023-04-11T16:12:53.557 INFO:teuthology.orchestra.run.smithi159.stderr:Waiting for mon to start...
2023-04-11T16:12:53.558 INFO:teuthology.orchestra.run.smithi159.stderr:Waiting for mon...
2023-04-11T16:12:53.877 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:53 smithi159 systemd[1]: Started Ceph mon.smithi159 for a33a9244-d883-11ed-9aff-001a4aab830c.
2023-04-11T16:12:55.127 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:54 smithi159 bash[23775]: cluster 2023-04-11T16:12:54.894493+0000 mon.smithi159 (mon.0) 0 :  [INF] mkfs a33a9244-d883-11ed-9aff-001a4aab830c
2023-04-11T16:12:55.127 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:54 smithi159 bash[23775]: cluster 2023-04-11T16:12:54.879790+0000 mon.smithi159 (mon.0) 1 : cluster [INF] mon.smithi159 is new leader, mons smithi159 in quorum (ranks 0)
2023-04-11T16:12:55.168 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:   cluster:
2023-04-11T16:12:55.169 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:     id:     a33a9244-d883-11ed-9aff-001a4aab830c
2023-04-11T16:12:55.169 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:     health: HEALTH_OK
2023-04-11T16:12:55.169 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:
2023-04-11T16:12:55.169 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:   services:
2023-04-11T16:12:55.169 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:     mon: 1 daemons, quorum smithi159 (age 0.282117s)
2023-04-11T16:12:55.169 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:     mgr: no daemons active
2023-04-11T16:12:55.170 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:     osd: 0 osds: 0 up, 0 in
2023-04-11T16:12:55.170 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:
2023-04-11T16:12:55.171 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:   data:
2023-04-11T16:12:55.171 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:     pools:   0 pools, 0 pgs
2023-04-11T16:12:55.171 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:     objects: 0 objects, 0 B
2023-04-11T16:12:55.171 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:     usage:   0 B used, 0 B / 0 B avail
2023-04-11T16:12:55.171 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:     pgs:
2023-04-11T16:12:55.171 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:
2023-04-11T16:12:55.674 INFO:teuthology.orchestra.run.smithi159.stderr:mon is available
2023-04-11T16:12:55.675 INFO:teuthology.orchestra.run.smithi159.stderr:Assimilating anything we can from ceph.conf...
2023-04-11T16:12:56.377 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:55 smithi159 bash[23775]: cluster 2023-04-11T16:12:54.889087+0000 mon.smithi159 (mon.0) 2 : cluster [INF] mon.smithi159 is new leader, mons smithi159 in quorum (ranks 0)
2023-04-11T16:12:56.377 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:55 smithi159 bash[23775]: cluster 2023-04-11T16:12:54.891338+0000 mon.smithi159 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} removed_ranks: {}
2023-04-11T16:12:56.378 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:55 smithi159 bash[23775]: cluster 2023-04-11T16:12:54.898468+0000 mon.smithi159 (mon.0) 4 : cluster [DBG] fsmap
2023-04-11T16:12:56.378 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:55 smithi159 bash[23775]: cluster 2023-04-11T16:12:54.909256+0000 mon.smithi159 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in
2023-04-11T16:12:56.378 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:55 smithi159 bash[23775]: cluster 2023-04-11T16:12:54.910152+0000 mon.smithi159 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active
2023-04-11T16:12:56.378 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:55 smithi159 bash[23775]: audit 2023-04-11T16:12:55.171117+0000 mon.smithi159 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.159:0/662042589' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch
2023-04-11T16:12:56.945 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:
2023-04-11T16:12:56.945 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph: [global]
2023-04-11T16:12:56.945 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph: 	fsid = a33a9244-d883-11ed-9aff-001a4aab830c
2023-04-11T16:12:56.947 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph: 	mon_host = [v2:172.21.15.159:3300,v1:172.21.15.159:6789]
2023-04-11T16:12:56.947 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph: 	mon_osd_allow_pg_remap = true
2023-04-11T16:12:56.947 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph: 	mon_osd_allow_primary_affinity = true
2023-04-11T16:12:56.947 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph: 	mon_warn_on_no_sortbitwise = false
2023-04-11T16:12:56.947 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph: 	osd_crush_chooseleaf_type = 0
2023-04-11T16:12:56.947 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:
2023-04-11T16:12:56.947 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph: [mgr]
2023-04-11T16:12:56.948 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph: 	mgr/telemetry/nag = false
2023-04-11T16:12:56.948 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph:
2023-04-11T16:12:56.948 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph: [osd]
2023-04-11T16:12:56.948 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph: 	osd_map_max_advance = 10
2023-04-11T16:12:56.948 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ceph: 	osd_sloppy_crc = true
2023-04-11T16:12:57.377 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:56 smithi159 bash[23775]: audit 2023-04-11T16:12:56.943827+0000 mon.smithi159 (mon.0) 8 : audit [INF] from='client.? 172.21.15.159:0/579119289' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch
2023-04-11T16:12:57.377 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:56 smithi159 bash[23775]: audit 2023-04-11T16:12:56.948306+0000 mon.smithi159 (mon.0) 9 : audit [INF] from='client.? 172.21.15.159:0/579119289' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished
2023-04-11T16:12:57.472 INFO:teuthology.orchestra.run.smithi159.stderr:Generating new minimal ceph.conf...
2023-04-11T16:12:59.064 INFO:teuthology.orchestra.run.smithi159.stderr:Restarting the monitor...
2023-04-11T16:12:59.074 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:58 smithi159 bash[23775]: audit 2023-04-11T16:12:58.583610+0000 mon.smithi159 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.159:0/574500764' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch
2023-04-11T16:12:59.377 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:59 smithi159 systemd[1]: Stopping Ceph mon.smithi159 for a33a9244-d883-11ed-9aff-001a4aab830c...
2023-04-11T16:12:59.377 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:59 smithi159 bash[24299]: Error response from daemon: No such container: ceph-a33a9244-d883-11ed-9aff-001a4aab830c-mon.smithi159
2023-04-11T16:12:59.377 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:59 smithi159 bash[23775]: debug 2023-04-11T16:12:59.246+0000 7fc292c24700 -1 received  signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.smithi159 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug  --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true  (PID: 1) UID: 0
2023-04-11T16:12:59.378 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:59 smithi159 bash[23775]: debug 2023-04-11T16:12:59.246+0000 7fc292c24700 -1 mon.smithi159@0(leader) e1 *** Got Signal Terminated ***
2023-04-11T16:13:00.066 INFO:teuthology.orchestra.run.smithi159.stderr:Setting mon public_network to 172.21.15.254/32,172.21.0.0/20
2023-04-11T16:13:00.377 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:12:59 smithi159 bash[24299]: ceph-a33a9244-d883-11ed-9aff-001a4aab830c-mon-smithi159
2023-04-11T16:13:00.377 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:00 smithi159 systemd[1]: Stopped Ceph mon.smithi159 for a33a9244-d883-11ed-9aff-001a4aab830c.
2023-04-11T16:13:00.378 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:00 smithi159 systemd[1]: Started Ceph mon.smithi159 for a33a9244-d883-11ed-9aff-001a4aab830c.
2023-04-11T16:13:01.377 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.238+0000 7f036eea1880  0 set uid:gid to 167:167 (ceph:ceph)
2023-04-11T16:13:01.378 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.238+0000 7f036eea1880  0 ceph version 16.2.11-391-g7170c9b9 (7170c9b95054b834ac0ed4c3453ebc92157b37e3) pacific (stable), process ceph-mon, pid 7
2023-04-11T16:13:01.378 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.238+0000 7f036eea1880  0 pidfile_write: ignore empty --pid-file
2023-04-11T16:13:01.378 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  0 load: jerasure load: lrc load: isa
2023-04-11T16:13:01.378 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: RocksDB version: 6.8.1
2023-04-11T16:13:01.378 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Git sha rocksdb_build_git_sha:@0@
2023-04-11T16:13:01.379 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Compile date Apr  6 2023
2023-04-11T16:13:01.379 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: DB SUMMARY
2023-04-11T16:13:01.379 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: CURRENT file:  CURRENT
2023-04-11T16:13:01.379 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: IDENTITY file:  IDENTITY
2023-04-11T16:13:01.379 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: MANIFEST file:  MANIFEST-000005 size: 131 Bytes
2023-04-11T16:13:01.379 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi159/store.db dir, Total Num: 1, files: 000004.sst
2023-04-11T16:13:01.379 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi159/store.db: 000006.log size: 86527 ;
2023-04-11T16:13:01.379 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                         Options.error_if_exists: 0
2023-04-11T16:13:01.380 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                       Options.create_if_missing: 0
2023-04-11T16:13:01.380 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                         Options.paranoid_checks: 1
2023-04-11T16:13:01.380 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                                     Options.env: 0x561804879080
2023-04-11T16:13:01.380 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                                      Options.fs: Posix File System
2023-04-11T16:13:01.380 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                                Options.info_log: 0x5618061c24c0
2023-04-11T16:13:01.380 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                Options.max_file_opening_threads: 16
2023-04-11T16:13:01.381 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                              Options.statistics: (nil)
2023-04-11T16:13:01.381 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                               Options.use_fsync: 0
2023-04-11T16:13:01.381 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                       Options.max_log_file_size: 0
2023-04-11T16:13:01.381 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                  Options.max_manifest_file_size: 1073741824
2023-04-11T16:13:01.381 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                   Options.log_file_time_to_roll: 0
2023-04-11T16:13:01.381 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                       Options.keep_log_file_num: 1000
2023-04-11T16:13:01.381 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                    Options.recycle_log_file_num: 0
2023-04-11T16:13:01.383 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                         Options.allow_fallocate: 1
2023-04-11T16:13:01.383 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                        Options.allow_mmap_reads: 0
2023-04-11T16:13:01.383 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                       Options.allow_mmap_writes: 0
2023-04-11T16:13:01.383 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                        Options.use_direct_reads: 0
2023-04-11T16:13:01.383 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                        Options.use_direct_io_for_flush_and_compaction: 0
2023-04-11T16:13:01.384 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:          Options.create_missing_column_families: 0
2023-04-11T16:13:01.384 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                              Options.db_log_dir:
2023-04-11T16:13:01.384 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                                 Options.wal_dir: /var/lib/ceph/mon/ceph-smithi159/store.db
2023-04-11T16:13:01.384 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                Options.table_cache_numshardbits: 6
2023-04-11T16:13:01.384 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                      Options.max_subcompactions: 1
2023-04-11T16:13:01.384 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                  Options.max_background_flushes: -1
2023-04-11T16:13:01.384 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                         Options.WAL_ttl_seconds: 0
2023-04-11T16:13:01.384 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                       Options.WAL_size_limit_MB: 0
2023-04-11T16:13:01.385 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                        Options.max_write_batch_group_size_bytes: 1048576
2023-04-11T16:13:01.385 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.manifest_preallocation_size: 4194304
2023-04-11T16:13:01.385 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                     Options.is_fd_close_on_exec: 1
2023-04-11T16:13:01.385 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                   Options.advise_random_on_open: 1
2023-04-11T16:13:01.385 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                    Options.db_write_buffer_size: 0
2023-04-11T16:13:01.385 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                    Options.write_buffer_manager: 0x561806eb4150
2023-04-11T16:13:01.385 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         Options.access_hint_on_compaction_start: 1
2023-04-11T16:13:01.385 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:  Options.new_table_reader_for_compaction_inputs: 0
2023-04-11T16:13:01.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:           Options.random_access_max_buffer_size: 1048576
2023-04-11T16:13:01.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                      Options.use_adaptive_mutex: 0
2023-04-11T16:13:01.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                            Options.rate_limiter: (nil)
2023-04-11T16:13:01.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:     Options.sst_file_manager.rate_bytes_per_sec: 0
2023-04-11T16:13:01.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                       Options.wal_recovery_mode: 2
2023-04-11T16:13:01.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                  Options.enable_thread_tracking: 0
2023-04-11T16:13:01.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                  Options.enable_pipelined_write: 0
2023-04-11T16:13:01.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                  Options.unordered_write: 0
2023-04-11T16:13:01.387 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         Options.allow_concurrent_memtable_write: 1
2023-04-11T16:13:01.387 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:      Options.enable_write_thread_adaptive_yield: 1
2023-04-11T16:13:01.387 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.write_thread_max_yield_usec: 100
2023-04-11T16:13:01.387 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:            Options.write_thread_slow_yield_usec: 3
2023-04-11T16:13:01.387 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                               Options.row_cache: None
2023-04-11T16:13:01.387 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                              Options.wal_filter: None
2023-04-11T16:13:01.387 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.avoid_flush_during_recovery: 0
2023-04-11T16:13:01.387 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.allow_ingest_behind: 0
2023-04-11T16:13:01.388 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.preserve_deletes: 0
2023-04-11T16:13:01.388 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.two_write_queues: 0
2023-04-11T16:13:01.388 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.manual_wal_flush: 0
2023-04-11T16:13:01.388 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.atomic_flush: 0
2023-04-11T16:13:01.388 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.avoid_unnecessary_blocking_io: 0
2023-04-11T16:13:01.388 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                 Options.persist_stats_to_disk: 0
2023-04-11T16:13:01.388 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                 Options.write_dbid_to_manifest: 0
2023-04-11T16:13:01.388 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                 Options.log_readahead_size: 0
2023-04-11T16:13:01.389 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                 Options.sst_file_checksum_func: Unknown
2023-04-11T16:13:01.389 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.max_background_jobs: 2
2023-04-11T16:13:01.389 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.max_background_compactions: -1
2023-04-11T16:13:01.389 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.avoid_flush_during_shutdown: 0
2023-04-11T16:13:01.389 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:           Options.writable_file_max_buffer_size: 1048576
2023-04-11T16:13:01.389 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.delayed_write_rate : 16777216
2023-04-11T16:13:01.389 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.max_total_wal_size: 0
2023-04-11T16:13:01.390 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.delete_obsolete_files_period_micros: 21600000000
2023-04-11T16:13:01.390 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                   Options.stats_dump_period_sec: 600
2023-04-11T16:13:01.390 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                 Options.stats_persist_period_sec: 600
2023-04-11T16:13:01.390 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                 Options.stats_history_buffer_size: 1048576
2023-04-11T16:13:01.390 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                          Options.max_open_files: -1
2023-04-11T16:13:01.390 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                          Options.bytes_per_sync: 0
2023-04-11T16:13:01.390 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                      Options.wal_bytes_per_sync: 0
2023-04-11T16:13:01.390 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                   Options.strict_bytes_per_sync: 0
2023-04-11T16:13:01.391 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:       Options.compaction_readahead_size: 0
2023-04-11T16:13:01.391 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Compression algorithms supported:
2023-04-11T16:13:01.391 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         kZSTDNotFinalCompression supported: 0
2023-04-11T16:13:01.391 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         kZSTD supported: 0
2023-04-11T16:13:01.391 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         kXpressCompression supported: 0
2023-04-11T16:13:01.391 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         kLZ4HCCompression supported: 1
2023-04-11T16:13:01.391 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         kLZ4Compression supported: 1
2023-04-11T16:13:01.391 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         kBZip2Compression supported: 0
2023-04-11T16:13:01.392 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         kZlibCompression supported: 1
2023-04-11T16:13:01.392 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         kSnappyCompression supported: 1
2023-04-11T16:13:01.392 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Fast CRC32 supported: Supported on x86
2023-04-11T16:13:01.392 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000005
2023-04-11T16:13:01.392 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]:
2023-04-11T16:13:01.392 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:               Options.comparator: leveldb.BytewiseComparator
2023-04-11T16:13:01.392 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:           Options.merge_operator:
2023-04-11T16:13:01.393 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:        Options.compaction_filter: None
2023-04-11T16:13:01.393 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:        Options.compaction_filter_factory: None
2023-04-11T16:13:01.393 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         Options.memtable_factory: SkipListFactory
2023-04-11T16:13:01.393 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:            Options.table_factory: BlockBasedTable
2023-04-11T16:13:01.393 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561806165d10)
2023-04-11T16:13:01.393 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   cache_index_and_filter_blocks: 1
2023-04-11T16:13:01.394 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   cache_index_and_filter_blocks_with_high_priority: 0
2023-04-11T16:13:01.394 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   pin_l0_filter_and_index_blocks_in_cache: 0
2023-04-11T16:13:01.394 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   pin_top_level_index_and_filter: 1
2023-04-11T16:13:01.394 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   index_type: 0
2023-04-11T16:13:01.394 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   data_block_index_type: 0
2023-04-11T16:13:01.394 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   index_shortening: 1
2023-04-11T16:13:01.394 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   data_block_hash_table_util_ratio: 0.750000
2023-04-11T16:13:01.395 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   hash_index_allow_collision: 1
2023-04-11T16:13:01.395 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   checksum: 1
2023-04-11T16:13:01.395 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   no_block_cache: 0
2023-04-11T16:13:01.395 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   block_cache: 0x56180619cf10
2023-04-11T16:13:01.395 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   block_cache_name: BinnedLRUCache
2023-04-11T16:13:01.395 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   block_cache_options:
2023-04-11T16:13:01.395 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:     capacity : 536870912
2023-04-11T16:13:01.396 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:     num_shard_bits : 4
2023-04-11T16:13:01.396 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:     strict_capacity_limit : 0
2023-04-11T16:13:01.396 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:     high_pri_pool_ratio: 0.000
2023-04-11T16:13:01.396 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   block_cache_compressed: (nil)
2023-04-11T16:13:01.396 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   persistent_cache: (nil)
2023-04-11T16:13:01.396 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   block_size: 4096
2023-04-11T16:13:01.396 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   block_size_deviation: 10
2023-04-11T16:13:01.396 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   block_restart_interval: 16
2023-04-11T16:13:01.397 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   index_block_restart_interval: 1
2023-04-11T16:13:01.397 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   metadata_block_size: 4096
2023-04-11T16:13:01.397 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   partition_filters: 0
2023-04-11T16:13:01.397 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   use_delta_encoding: 1
2023-04-11T16:13:01.397 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   filter_policy: rocksdb.BuiltinBloomFilter
2023-04-11T16:13:01.397 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   whole_key_filtering: 1
2023-04-11T16:13:01.397 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   verify_compression: 0
2023-04-11T16:13:01.398 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   read_amp_bytes_per_bit: 0
2023-04-11T16:13:01.398 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   format_version: 2
2023-04-11T16:13:01.398 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   enable_index_compression: 1
2023-04-11T16:13:01.398 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   block_align: 0
2023-04-11T16:13:01.398 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:        Options.write_buffer_size: 33554432
2023-04-11T16:13:01.398 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:  Options.max_write_buffer_number: 2
2023-04-11T16:13:01.398 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:          Options.compression: NoCompression
2023-04-11T16:13:01.398 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                  Options.bottommost_compression: Disabled
2023-04-11T16:13:01.399 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:       Options.prefix_extractor: nullptr
2023-04-11T16:13:01.399 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:   Options.memtable_insert_with_hint_prefix_extractor: nullptr
2023-04-11T16:13:01.399 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.num_levels: 7
2023-04-11T16:13:01.399 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:        Options.min_write_buffer_number_to_merge: 1
2023-04-11T16:13:01.399 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:     Options.max_write_buffer_number_to_maintain: 0
2023-04-11T16:13:01.399 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:     Options.max_write_buffer_size_to_maintain: 0
2023-04-11T16:13:01.399 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:            Options.bottommost_compression_opts.window_bits: -14
2023-04-11T16:13:01.399 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                  Options.bottommost_compression_opts.level: 32767
2023-04-11T16:13:01.400 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:               Options.bottommost_compression_opts.strategy: 0
2023-04-11T16:13:01.400 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         Options.bottommost_compression_opts.max_dict_bytes: 0
2023-04-11T16:13:01.400 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2023-04-11T16:13:01.400 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                  Options.bottommost_compression_opts.enabled: false
2023-04-11T16:13:01.400 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:            Options.compression_opts.window_bits: -14
2023-04-11T16:13:01.400 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                  Options.compression_opts.level: 32767
2023-04-11T16:13:01.400 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:               Options.compression_opts.strategy: 0
2023-04-11T16:13:01.400 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         Options.compression_opts.max_dict_bytes: 0
2023-04-11T16:13:01.401 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:         Options.compression_opts.zstd_max_train_bytes: 0
2023-04-11T16:13:01.401 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                  Options.compression_opts.enabled: false
2023-04-11T16:13:01.401 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:      Options.level0_file_num_compaction_trigger: 4
2023-04-11T16:13:01.401 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:          Options.level0_slowdown_writes_trigger: 20
2023-04-11T16:13:01.401 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:              Options.level0_stop_writes_trigger: 36
2023-04-11T16:13:01.401 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                   Options.target_file_size_base: 67108864
2023-04-11T16:13:01.401 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:             Options.target_file_size_multiplier: 1
2023-04-11T16:13:01.402 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                Options.max_bytes_for_level_base: 268435456
2023-04-11T16:13:01.402 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1
2023-04-11T16:13:01.402 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:          Options.max_bytes_for_level_multiplier: 10.000000
2023-04-11T16:13:01.402 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
2023-04-11T16:13:01.402 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
2023-04-11T16:13:01.402 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
2023-04-11T16:13:01.402 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
2023-04-11T16:13:01.402 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
2023-04-11T16:13:01.403 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
2023-04-11T16:13:01.403 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
2023-04-11T16:13:01.403 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:       Options.max_sequential_skip_in_iterations: 8
2023-04-11T16:13:01.403 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                    Options.max_compaction_bytes: 1677721600
2023-04-11T16:13:01.403 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                        Options.arena_block_size: 4194304
2023-04-11T16:13:01.403 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:   Options.soft_pending_compaction_bytes_limit: 68719476736
2023-04-11T16:13:01.403 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:   Options.hard_pending_compaction_bytes_limit: 274877906944
2023-04-11T16:13:01.403 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:       Options.rate_limit_delay_max_milliseconds: 100
2023-04-11T16:13:01.404 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                Options.disable_auto_compactions: 0
2023-04-11T16:13:01.404 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                        Options.compaction_style: kCompactionStyleLevel
2023-04-11T16:13:01.404 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                          Options.compaction_pri: kMinOverlappingRatio
2023-04-11T16:13:01.404 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.compaction_options_universal.size_ratio: 1
2023-04-11T16:13:01.404 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
2023-04-11T16:13:01.404 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
2023-04-11T16:13:01.405 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
2023-04-11T16:13:01.405 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
2023-04-11T16:13:01.405 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2023-04-11T16:13:01.405 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
2023-04-11T16:13:01.405 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
2023-04-11T16:13:01.405 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                   Options.table_properties_collectors:
2023-04-11T16:13:01.405 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                   Options.inplace_update_support: 0
2023-04-11T16:13:01.405 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                 Options.inplace_update_num_locks: 10000
2023-04-11T16:13:01.406 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:               Options.memtable_prefix_bloom_size_ratio: 0.000000
2023-04-11T16:13:01.406 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:               Options.memtable_whole_key_filtering: 0
2023-04-11T16:13:01.406 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:   Options.memtable_huge_page_size: 0
2023-04-11T16:13:01.406 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                           Options.bloom_locality: 0
2023-04-11T16:13:01.406 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                    Options.max_successive_merges: 0
2023-04-11T16:13:01.406 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                Options.optimize_filters_for_hits: 0
2023-04-11T16:13:01.406 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                Options.paranoid_file_checks: 0
2023-04-11T16:13:01.406 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                Options.force_consistency_checks: 0
2023-04-11T16:13:01.407 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                Options.report_bg_io_stats: 0
2023-04-11T16:13:01.407 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:                               Options.ttl: 2592000
2023-04-11T16:13:01.407 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.242+0000 7f036eea1880  4 rocksdb:          Options.periodic_compaction_seconds: 0
2023-04-11T16:13:01.407 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.246+0000 7f036eea1880  4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
2023-04-11T16:13:01.407 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.246+0000 7f036eea1880  4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4
2023-04-11T16:13:01.407 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.246+0000 7f036eea1880  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1681229581250075, "job": 1, "event": "recovery_started", "log_files": [6]}
2023-04-11T16:13:01.407 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.246+0000 7f036eea1880  4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2
2023-04-11T16:13:01.408 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.246+0000 7f036eea1880  3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5.
2023-04-11T16:13:01.408 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.246+0000 7f036eea1880  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1681229581251981, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 83400, "table_properties": {"data_size": 81667, "index_size": 338, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 9331, "raw_average_key_size": 47, "raw_value_size": 76179, "raw_average_value_size": 384, "num_data_blocks": 11, "num_entries": 198, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1681229581, "oldest_key_time": 3, "file_creation_time": 0}}
2023-04-11T16:13:01.408 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.246+0000 7f036eea1880  4 rocksdb: [version_set.cc:3826] Creating manifest 8
2023-04-11T16:13:01.408 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.250+0000 7f036eea1880  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1681229581252899, "job": 1, "event": "recovery_finished"}
2023-04-11T16:13:01.408 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.250+0000 7f036eea1880  4 rocksdb: DB pointer 0x561806265800
2023-04-11T16:13:01.408 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.250+0000 7f0355cb1700  4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS -------
2023-04-11T16:13:01.408 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.250+0000 7f0355cb1700  4 rocksdb: [db_impl/db_impl.cc:851]
2023-04-11T16:13:01.408 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: ** DB Stats **
2023-04-11T16:13:01.409 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Uptime(secs): 0.0 total, 0.0 interval
2023-04-11T16:13:01.409 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
2023-04-11T16:13:01.409 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
2023-04-11T16:13:01.409 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
2023-04-11T16:13:01.409 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
2023-04-11T16:13:01.409 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
2023-04-11T16:13:01.409 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
2023-04-11T16:13:01.410 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: ** Compaction Stats [default] **
2023-04-11T16:13:01.410 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
2023-04-11T16:13:01.410 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
2023-04-11T16:13:01.410 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   L0      2/0   83.14 KB   0.5      0.0     0.0      0.0       0.0      0.0       0.0   1.0      0.0     68.7      0.00              0.00         1    0.001       0      0
2023-04-11T16:13:01.410 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:  Sum      2/0   83.14 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   1.0      0.0     68.7      0.00              0.00         1    0.001       0      0
2023-04-11T16:13:01.410 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:  Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   1.0      0.0     68.7      0.00              0.00         1    0.001       0      0
2023-04-11T16:13:01.410 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: ** Compaction Stats [default] **
2023-04-11T16:13:01.410 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
2023-04-11T16:13:01.411 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
2023-04-11T16:13:01.411 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: User      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0     68.7      0.00              0.00         1    0.001       0      0
2023-04-11T16:13:01.411 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Uptime(secs): 0.0 total, 0.0 interval
2023-04-11T16:13:01.411 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Flush(GB): cumulative 0.000, interval 0.000
2023-04-11T16:13:01.411 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: AddFile(GB): cumulative 0.000, interval 0.000
2023-04-11T16:13:01.411 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: AddFile(Total Files): cumulative 0, interval 0
2023-04-11T16:13:01.411 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: AddFile(L0 Files): cumulative 0, interval 0
2023-04-11T16:13:01.411 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: AddFile(Keys): cumulative 0, interval 0
2023-04-11T16:13:01.412 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Cumulative compaction: 0.00 GB write, 11.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
2023-04-11T16:13:01.412 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Interval compaction: 0.00 GB write, 11.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
2023-04-11T16:13:01.412 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
2023-04-11T16:13:01.412 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: ** File Read Latency Histogram By Level [default] **
2023-04-11T16:13:01.412 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: ** Compaction Stats [default] **
2023-04-11T16:13:01.412 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
2023-04-11T16:13:01.412 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
2023-04-11T16:13:01.412 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:   L0      2/0   83.14 KB   0.5      0.0     0.0      0.0       0.0      0.0       0.0   1.0      0.0     68.7      0.00              0.00         1    0.001       0      0
2023-04-11T16:13:01.413 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:  Sum      2/0   83.14 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   1.0      0.0     68.7      0.00              0.00         1    0.001       0      0
2023-04-11T16:13:01.413 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:  Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
2023-04-11T16:13:01.413 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: ** Compaction Stats [default] **
2023-04-11T16:13:01.413 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
2023-04-11T16:13:01.413 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
2023-04-11T16:13:01.413 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: User      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0     68.7      0.00              0.00         1    0.001       0      0
2023-04-11T16:13:01.413 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Uptime(secs): 0.0 total, 0.0 interval
2023-04-11T16:13:01.414 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Flush(GB): cumulative 0.000, interval 0.000
2023-04-11T16:13:01.414 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: AddFile(GB): cumulative 0.000, interval 0.000
2023-04-11T16:13:01.414 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: AddFile(Total Files): cumulative 0, interval 0
2023-04-11T16:13:01.414 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: AddFile(L0 Files): cumulative 0, interval 0
2023-04-11T16:13:01.414 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: AddFile(Keys): cumulative 0, interval 0
2023-04-11T16:13:01.414 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Cumulative compaction: 0.00 GB write, 11.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
2023-04-11T16:13:01.414 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
2023-04-11T16:13:01.415 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
2023-04-11T16:13:01.415 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: ** File Read Latency Histogram By Level [default] **
2023-04-11T16:13:01.415 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.250+0000 7f036eea1880  0 starting mon.smithi159 rank 0 at public addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] at bind addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi159 fsid a33a9244-d883-11ed-9aff-001a4aab830c
2023-04-11T16:13:01.415 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.254+0000 7f036eea1880  1 mon.smithi159@-1(???) e1 preinit fsid a33a9244-d883-11ed-9aff-001a4aab830c
2023-04-11T16:13:01.415 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.254+0000 7f036eea1880  0 mon.smithi159@-1(???).mds e1 new map
2023-04-11T16:13:01.415 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.254+0000 7f036eea1880  0 mon.smithi159@-1(???).mds e1 print_map
2023-04-11T16:13:01.415 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: e1
2023-04-11T16:13:01.416 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: enable_multiple, ever_enabled_multiple: 1,1
2023-04-11T16:13:01.416 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
2023-04-11T16:13:01.416 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: legacy client fscid: -1
2023-04-11T16:13:01.416 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]:
2023-04-11T16:13:01.416 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: No filesystems configured
2023-04-11T16:13:01.416 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.254+0000 7f036eea1880  0 mon.smithi159@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires
2023-04-11T16:13:01.416 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.254+0000 7f036eea1880  0 mon.smithi159@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires
2023-04-11T16:13:01.417 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: audit 2023-04-11T16:12:58.583610+0000 mon.smithi159 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.159:0/574500764' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch
2023-04-11T16:13:01.417 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: debug 2023-04-11T16:13:01.254+0000 7f036eea1880  1 mon.smithi159@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3
2023-04-11T16:13:01.417 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: cluster 2023-04-11T16:13:01.262850+0000 mon.smithi159 (mon.0) 1 : cluster [INF] mon.smithi159 is new leader, mons smithi159 in quorum (ranks 0)
2023-04-11T16:13:01.417 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: cluster 2023-04-11T16:13:01.262939+0000 mon.smithi159 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} removed_ranks: {}
2023-04-11T16:13:01.417 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: cluster 2023-04-11T16:13:01.263622+0000 mon.smithi159 (mon.0) 3 : cluster [DBG] fsmap
2023-04-11T16:13:01.417 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: cluster 2023-04-11T16:13:01.263678+0000 mon.smithi159 (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in
2023-04-11T16:13:01.417 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Apr 11 16:13:01 smithi159 bash[24422]: cluster 2023-04-11T16:13:01.264248+0000 mon.smithi159 (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active
2023-04-11T16:13:02.149 INFO:teuthology.orchestra.run.smithi159.stderr:Wrote config to /etc/ceph/ceph.conf
2023-04-11T16:13:02.150 INFO:teuthology.orchestra.run.smithi159.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring
2023-04-11T16:13:02.150 INFO:teuthology.orchestra.run.smithi159.stderr:Creating mgr...
2023-04-11T16:13:02.150 INFO:teuthology.orchestra.run.smithi159.stderr:Verifying port 9283 ...
2023-04-11T16:13:02.204 DEBUG:teuthology.exit:Got signal 15; running 1 handler...
2023-04-11T16:13:02.258 DEBUG:teuthology.task.console_log:Killing console logger for smithi159
2023-04-11T16:13:02.259 DEBUG:teuthology.task.console_log:Killing console logger for smithi187
2023-04-11T16:13:02.260 DEBUG:teuthology.exit:Finished running handlers