Quick install¶
Install the driver on a Linux server with an LPU card, and check that the SDK sees the card. SDK installation is covered here only; the component guides do not repeat it.
What you need¶
| Server | x86_64, Ubuntu 22.04 or 24.04 |
| Card | One or more LPUs |
| Privileges | root, for the driver |
| Containers | Docker 25 or later, or containerd |
| Account | The user name and password HyperAccel issued, and the hyperaccel-keyring file |
The driver and the images all come from public.hyperaccel.net, after logging in with this account.
1. Check the card¶
1 | |
20fb is HyperAccel's PCI vendor ID. You should see one line per card.
If nothing shows up, the problem is below the driver: check that the card is seated and powered, and the BIOS PCIe settings.
2. Driver and toolkit¶
Install once on the host, never inside a container.
1 2 3 4 5 6 7 8 9 10 11 | |
hyperaccel-lpu installs the kernel driver (hyperdriver-dkms) and the container toolkit (ha-container-toolkit).
The driver is registered with DKMS, so it is rebuilt on kernel upgrades and loaded at boot.
The toolkit lets containers ask for cards by name (hyperaccel.ai/lpu). See Container support.
Each card now has a device file:
1 2 | |
hyperaccel-smi shows each card's state: temperature, power, memory use and firmware version.
For servers with Secure Boot, see Installing the driver.
To read more about the driver install (supported environments, verifying the install, upgrading and removing), see Driver installation and setup.
3. SDK images¶
The SDK comes as container images. Log in with the same account.
1 | |
| Image | Used for |
|---|---|
public.hyperaccel.net/hyperaccel-public/hyperaccel-sdk:v0.0.6 |
PyTorch, kernels |
public.hyperaccel.net/hyperaccel-public/vllm-hyperaccel:0.0.6 |
vLLM serving |
The image tag rules are in Releases.
4. Check the card from the SDK¶
1 2 3 | |
If it prints the number of cards, you are done. Go on to the Quickstart.
Without CDI, pass the device files one by one instead of --device hyperaccel.ai/lpu=all: --device /dev/ha0 --device /dev/ha1.
If you get stuck¶
| Symptom | Where to look |
|---|---|
Nothing from lspci -d 20fb: |
Card seating, power, BIOS |
401 from apt update |
The user name and password in /etc/apt/auth.conf.d/hyperaccel.conf |
No /dev/ha* |
sudo dmesg \| grep -i ha for why the module failed to load. Verifying the driver |
unauthorized from docker pull |
docker login public.hyperaccel.net, and hyperaccel-public/ in the image name |
PermissionError: /dev/ha0 |
Device file permissions. Permissions |
get_device_count() returns 0 |
--device missing, or CDI not enabled |