APAI-LAB05: Tiny Transformers

Material

1. Assignment: here
2. Slides: here

Reminders:

1. Multi-head Self Attention
2. Full-Stack Transformer

How to deliver the assignment:

Use Virtuale, upload only the assignment file named as follows: LAB#_APAI_yourname.pdf

Assignment DEADLINE: 07/11/2025 (at 15:30)

---

Quickstart

How to set the environment (Your PC)

1. Open a terminal
2. Go into 'APAI-Docker' folder.
3. Open VSCode with 'code .'
4. On VSCode, click on 'Reopen in container'.
5. Open you new terminal in VSCode and launch the following commands to clone this repository:

git clone https://github.com/EEESlab/APAI25-LAB05-TinyTransformers 
cd APAI25-LAB05-TinyTransformers/

5. Now you're ready to start!

How to set the environment (LAB1)

1. Open the VirtualBox virtual machine
2. Open a terminal (CTRL+T or open terminal)
3. Go into 'APAI-Docker' folder.
4. Open VSCode with 'code .'
5. On VSCode, click on 'Reopen in container'.
6. Open you new terminal in VSCode and launch the following commands to clone this repository:

git clone https://github.com/EEESlab/APAI25-LAB05-TinyTransformers 
cd APAI25-LAB05-TinyTransformers/

7. Now you're ready to start!

How to run the code

[DO NOT FORGET] Every time you open a new terminal run:

source setup-pulp-sdk.sh

To run the code enter in a terminal:

make clean all run

Also before running any command in this folder, make sure to:

source initialization.sh