Skip to content

Quick install

Install the driver on a Linux server with an LPU card, and check that the SDK sees the card. SDK installation is covered here only; the component guides do not repeat it.

What you need

Server x86_64, Ubuntu 22.04 or 24.04
Card One or more LPUs
Privileges root, for the driver
Containers Docker 25 or later, or containerd
Account The user name and password HyperAccel issued, and the hyperaccel-keyring file

The driver and the images all come from public.hyperaccel.net, after logging in with this account.

1. Check the card

1
lspci -d 20fb:

20fb is HyperAccel's PCI vendor ID. You should see one line per card. If nothing shows up, the problem is below the driver: check that the card is seated and powered, and the BIOS PCIe settings.

2. Driver and toolkit

Install once on the host, never inside a container.

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
sudo apt install -y dkms linux-headers-$(uname -r)

# The account apt logs in to HyperAccel's repository with
sudo tee /etc/apt/auth.conf.d/hyperaccel.conf > /dev/null <<'EOF'
machine public.hyperaccel.net login <user> password <password>
EOF
sudo chmod 600 /etc/apt/auth.conf.d/hyperaccel.conf

sudo apt install -y ./hyperaccel-keyring_<version>_all.deb    # the file that came with the account; registers the repository and its signing key
sudo apt update
sudo apt install -y hyperaccel-lpu

hyperaccel-lpu installs the kernel driver (hyperdriver-dkms) and the container toolkit (ha-container-toolkit). The driver is registered with DKMS, so it is rebuilt on kernel upgrades and loaded at boot. The toolkit lets containers ask for cards by name (hyperaccel.ai/lpu). See Container support.

Each card now has a device file:

1
2
ls /dev/ha*
hyperaccel-smi

hyperaccel-smi shows each card's state: temperature, power, memory use and firmware version. For servers with Secure Boot, see Installing the driver.

To read more about the driver install (supported environments, verifying the install, upgrading and removing), see Driver installation and setup.

3. SDK images

The SDK comes as container images. Log in with the same account.

1
docker login public.hyperaccel.net
Image Used for
public.hyperaccel.net/hyperaccel-public/hyperaccel-sdk:v0.0.6 PyTorch, kernels
public.hyperaccel.net/hyperaccel-public/vllm-hyperaccel:0.0.6 vLLM serving

The image tag rules are in Releases.

4. Check the card from the SDK

1
2
3
docker run --rm --device hyperaccel.ai/lpu=all --entrypoint python3 \
  public.hyperaccel.net/hyperaccel-public/hyperaccel-sdk:v0.0.6 \
  -c "import hart; print(hart.get_device_count())"

If it prints the number of cards, you are done. Go on to the Quickstart.

Without CDI, pass the device files one by one instead of --device hyperaccel.ai/lpu=all: --device /dev/ha0 --device /dev/ha1.

If you get stuck

Symptom Where to look
Nothing from lspci -d 20fb: Card seating, power, BIOS
401 from apt update The user name and password in /etc/apt/auth.conf.d/hyperaccel.conf
No /dev/ha* sudo dmesg \| grep -i ha for why the module failed to load. Verifying the driver
unauthorized from docker pull docker login public.hyperaccel.net, and hyperaccel-public/ in the image name
PermissionError: /dev/ha0 Device file permissions. Permissions
get_device_count() returns 0 --device missing, or CDI not enabled