Ceph

Ubuntu

Desactivar servicios

 systemctl disable cloud-config.service cloud-final.service cloud-init-local.service cloud-init.service iscsi.service iscsid.service lvm2-monitor.service lxcfs.service lxd-containers.service open-iscsi.service  unattended-upgrades.service

Instalar sysstat para monitor sistema y fio para probar velocidad de disco duro

 apt install sysstat fio sysbench

Para systat se cambia /etc/default/sysstat de "false" a "true"

Probar con ...

 sar -A

Nuevo usario para Ceph

 useradd -m master -S /bin/bash -G sudo

Cambiar /etc/sudo con visudo

 visudo

 ...
 #%sudo   ALL=(ALL:ALL) ALL
 %sudo   ALL=NOPASSWD: ALL
 ...

Cambiar /etc/hostname a master (node1, node2, node3)

/etc/hosts para todo nodes incluido admin-node master

10.250.30.202   master.local.site master
10.250.30.203   node1.local.site node1
10.250.30.204   node2.local.site node2
10.250.30.205   node3.local.site node3

En mi portátil disponer accesso al admin-node master

 ssh-copy-id master@10.250.30.202

con2master es un alias en ~/.bashrc "alias con2master='ssh master@10.250.30.202'". Con ese commando pruebo el accesso

 con2master

En Raspberry crear un clave para ssh con usario master

 ssh-keygen

Copiar clave público a /home/master/.ssh/authorized_keys

 ssh-copy-id master@master

Cancelar el proyecto con Ubuntu

Causa: Ceph.com no dispone paquetes para armhf, sino para aarm64. Ubuntu no dispone una distribución para Raspberry en arquitectura aarm64, sino solo armhf. Por eso no tenía un paquete "ceph-mon" o "ceph-osd".

opensuse tumbleweed/leep

ceph-mon cancela con mensaje "illegal instruction"

 node1:/etc/ceph # /usr/bin/ceph-mon -f --cluster ceph --id node1 --setuser ceph --setgroup ceph

Salida:

 *** Caught signal (Illegal instruction) **
 in thread ffffac027ee0 thread_name:msgr-worker-2
 ceph version 13.0.1-2078-g85df538001 (85df5380012dc6b0c18645c783d428d6e8a9fc06) mimic (dev)
 1: (()+0x41eba0) [0xaaaaea34fba0]
 2: (__kernel_rt_sigreturn()+0) [0xffffbea0766c]
 3: (ceph_crc32c_aarch64()+0x4a0) [0xffffb662c5d8]
 4: (ceph::buffer::list::crc32c(unsigned int) const+0xdc) [0xffffb61e3184]
 5: (Message::encode(unsigned long, int)+0x108) [0xffffb62a4200]
 6: (AsyncConnection::prepare_send_message(unsigned long, Message*, ceph::buffer::list&)+0x1b0) [0xffffb6336ee8]
 7: (AsyncConnection::handle_write()+0x26c) [0xffffb633cc4c]
 8: (EventCenter::process_events(int, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> >*)+0xacc) [0xffffb63572e4]
 9: (()+0x3ad35c) [0xffffb635a35c]
 10: (()+0xc2d4c) [0xffffb5d69d4c]
 11: (()+0x705c) [0xffffb5f7f05c]
 12: (()+0xd3e3c) [0xffffb5b02e3c]
 2018-03-18 03:23:31.062 ffffac027ee0 -1 *** Caught signal (Illegal instruction) **
 in thread ffffac027ee0 thread_name:msgr-worker-2
 
 ceph version 13.0.1-2078-g85df538001 (85df5380012dc6b0c18645c783d428d6e8a9fc06) mimic (dev)
 1: (()+0x41eba0) [0xaaaaea34fba0]
 2: (__kernel_rt_sigreturn()+0) [0xffffbea0766c]
 3: (ceph_crc32c_aarch64()+0x4a0) [0xffffb662c5d8]
 4: (ceph::buffer::list::crc32c(unsigned int) const+0xdc) [0xffffb61e3184]
 5: (Message::encode(unsigned long, int)+0x108) [0xffffb62a4200]
 6: (AsyncConnection::prepare_send_message(unsigned long, Message*, ceph::buffer::list&)+0x1b0) [0xffffb6336ee8]
 7: (AsyncConnection::handle_write()+0x26c) [0xffffb633cc4c]
 8: (EventCenter::process_events(int, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> >*)+0xacc) [0xffffb63572e4]
 9: (()+0x3ad35c) [0xffffb635a35c]
 10: (()+0xc2d4c) [0xffffb5d69d4c]
 11: (()+0x705c) [0xffffb5f7f05c]
 12: (()+0xd3e3c) [0xffffb5b02e3c]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
 
     0> 2018-03-18 03:23:31.062 ffffac027ee0 -1 *** Caught signal (Illegal instruction) **
 in thread ffffac027ee0 thread_name:msgr-worker-2
 
 ceph version 13.0.1-2078-g85df538001 (85df5380012dc6b0c18645c783d428d6e8a9fc06) mimic (dev)
 1: (()+0x41eba0) [0xaaaaea34fba0]
 2: (__kernel_rt_sigreturn()+0) [0xffffbea0766c]
 3: (ceph_crc32c_aarch64()+0x4a0) [0xffffb662c5d8]
 4: (ceph::buffer::list::crc32c(unsigned int) const+0xdc) [0xffffb61e3184]
 5: (Message::encode(unsigned long, int)+0x108) [0xffffb62a4200]
 6: (AsyncConnection::prepare_send_message(unsigned long, Message*, ceph::buffer::list&)+0x1b0) [0xffffb6336ee8]
 7: (AsyncConnection::handle_write()+0x26c) [0xffffb633cc4c]
 8: (EventCenter::process_events(int, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> >*)+0xacc) [0xffffb63572e4]
 9: (()+0x3ad35c) [0xffffb635a35c]
 10: (()+0xc2d4c) [0xffffb5d69d4c]
 11: (()+0x705c) [0xffffb5f7f05c]
 12: (()+0xd3e3c) [0xffffb5b02e3c]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
 
 
 Ungültiger Maschinenbefehl (core dumped)

Según investigación probablemente será que ceph no es compatible con raspberry pi