LicheePi Cluster 3A
Update history
Date | Version | Author | Update content |
---|---|---|---|
2023-07-30 | v0.1 | zepan |
|
Intro
The Lichee Cluster 3A (hereinafter referred to as LC3A) is a high-performance RISC-V cluster computing platform developed by Sipeed. It can be used to build multi-node computing clusters and is an excellent tool for learning Kubernetes, automation, edge AI computing, local mini-servers, hosting applications, and containers. A single Lichee Cluster 3A can accommodate up to 7 LM3A core boards, each featuring an NPU with 2 TOPS@int8 AI computing power, supporting up to 16GB of LPDDR4X memory and 128GB of eMMC storage per core board. The entire cluster offers robust flexibility and scalability.
The Lichee Cluster 3A comes with an onboard eight-port gigabit switch to provide high-speed connections, easily linking multiple nodes to form a powerful computing cluster. It also supports USB 3.0 and SD card storage expansion, allowing for easy addition of extra storage or peripheral devices.
Additionally, the Lichee Cluster 3A is equipped with a BMC (Baseboard Management Controller) for out-of-band management. The BMC independently connects to the system serial port and reset pins of each LM3A. It can reset individual compute nodes from the hardware level and execute commands via the serial port, such as using ser2net or kermit to manage slots.
Tech Spec
SOMs | LM3A * 7 |
CPU | RiscV X60@1.6GHz * 8 * 7 |
GPU | IMG™ B BXE-2-32 * 7 |
NPU | 2TOPS@INT8 * 7 |
RAM | 最大 16GB * 7 |
EMMC | Maximum 128GB * 7 |
BMC | SIPEED Lichee RV |
Ethernet | GbE 1(Slot#1) GbE 2(交换机) 100M Ethernet(BMC) |
USB | USB3.0 * 7 (LM3A) USB2.0 * 1 (BMC) |
HDMI | HDMI * 1 (Slot 1) |
SDCARD | TF * 7 |
Power | support DC powerin support ATX 24PIN power |
RTC | CR2032 Button cell |
heat radiation | 5V PWM FAN * 7 12V 4PIN PWM FAN * 1 |
Size | Mini ITX, 17 * 17 cm (6.7 * 6.7 inch) optional MINI ITX case, 20 * 12 * 22 cm |
Hardware system
Motherboard introduction
Motherboard frame diagram
LicheeRV SOM (D1 C906@1GHz) has 5 native serial ports and two USB serial ports, which are independently connected to 7 SOMs.
Each LM3A's RST/BOOT can be controlled via an analog switch.
LM3A No. 1 has the second Gigabit port and HDMI port by default, which facilitates the SOM to perform task distribution operations for the entire cluster.
The motherboard can be powered by a 12V DC charging head (12V9A or above recommended), or by a standard ATX power supply.
Chassis introduction
It is recommended to choose the MINI-ITX chassis. This chassis has good appearance and heat dissipation performance, and is convenient for the deployment and display of computing clusters.
The chassis is adapted to the MINI-ITX motherboard, equipped with a 250W high-power power supply, and installed with a 12cm silent fan for heat dissipation, which can ensure that the CPU temperature is below 70 degrees when running at full load.
Hardware Installation Guide
By default, all SOMs have been installed on the LC3A during transportation. If you need to remove or upgrade the SOM, please refer to the following instructions.
Install core board
Pull the white lock buckle to both sides. Please confirm the gap before inserting to avoid damage caused by incorrect direction.
After placing the core board, apply downward pressure evenly
After hearing a click, confirm that the white lock is properly engaged and the installation is complete. If you need to take out the core board, just pull the white locks to both sides.
Install BMC
Install the burned image SD card to LicheeRV, then install the LicheeRV module to the seat next to the switch chip, and then tighten the screws.
Plug in power
Optional ATX power supply or DC movie power supply.
Make sure the buckle of the ATX power socket is fastened to avoid poor contact causing the connector to heat up.
Plug in the jumper cap
Internet connection
The cluster system mainly connects to two external network ports: 1. Onboard Gigabit switch network port 2. BMC network port
It is recommended that the onboard Gigabit switch network port be connected to the user's intranet or main network for the cluster to obtain required network data.
It is recommended that the BMC network port be connected to an independent network for cluster control, which is more secure.
The clusters are connected internally through Gigabit switches.
How to get the cluster’s IP address:
The pre-installed firmware installation has the mdns service enabled
Enable avahi service on your PC (Linux)
Use mdns to scan the entire network to obtain the mdns domain name information of lc3a:
avahi-browse-art | grep lc3a
Then use:
ssh debin@lc3aXXXX.local
XXXX is the last four digits of the mac address, used to distinguish each slot
Software system
LM3A Mirror
The LM3A SOM in the cluster can directly use the LicheePi3A image.
If you need to enable USB, you can apply the following PATCH in the Linux device tree: [Click here to download](https://dl.sipeed.com/fileList/LICHEE/LicheeCluster3A/04_Firmware/lpi3a/src/linux/0001-arch- riscv-boot-dts-lpi3a-disable-i2c-io-expander-fo.patch)
Or use the precompiled image directly: Click here to download
Image burning method:
Press the BOOT button and press the RST button at the same time, then use the A to A male USB cable to connect to the computer
Burn using fastboot tool
OpenBMC Image
The LicheeRV SOM on the motherboard runs OpenBMC to manage the SOM on the motherboard.
Mirror download address: Click here to jump
Image burning method:
bmaptool copy obmc-phosphor-image-lichepi-rv.wic.gz /dev/YOUR_SDCARD
Default username: root
Default password: 0penBmc
0 is zero, not O
If you need to develop customization, please download PATCH:
https://dl.sipeed.com/shareURL/LICHEE/LicheeCluster3A/04_Firmware/bmc/src
And applied to OpenBMC source code:
git clone https://github.com/openbmc/openbmc/
git checkout commit-id
git amxxx.patch
OpenBMC Management
Access Slot's serial port from SSH:
ssh -p 2301 root@bmcip # access first slot's serial port
Port 22: OpenBMC shell
Port 2301: SOL (Serial Over LAN) of slot1
Port 2302: SOL for slot2
Port 2303: SOL for slot3
Port 2304: SOL for slot4
Port 2305: SOL for slot5
Port 2306: SOL for slot6
Port 2307: SOL for slot7
The serial port of each Slot is output to the log:
cat /var/log/obmc-cons*.log