Embedded Systems

Course manual 2024/2025

Course content

Embedded systems are now ubiquitous starting from your smartphones to other smart devices. Heterogeneous Multi-Processors System-on-Chip (HMPSoCs) power the state-of-the-art embedded systems. HMPSoCs contain highly capable multi-cluster multi-core CPUs and GPUs that enable high-end embedded applications. Machine Learning (ML)-based computer vision using Convolutional Neural Networks (CNNs) applications are one such class of applications increasingly deploying on embedded systems.

Embedded systems operate in power-constrained environments. While the application developers care about the functional correctness and accuracy of the deployed CNNs, embedded system developers need to worry about their extra-functional properties, like power efficiency. Moreover, it is also not always possible to alter the application to improve power efficiency. Therefore, embedded system developers must exploit their detailed understanding of the system to minimize the CNNs' power consumption while still meeting the stipulated performance requirement. They must use all the power management knobs available to enable the most power-efficient CNN inference.

In embedded systems, application-specific Operating Systems (OS) sub-routines, called Governors, manage the overlying application's power consumption. Governors deploy complex algorithms internally to maximize power efficiency. In this course, we will learn to write Governors for optimizing the power consumption of CNNs deployed on HMPSoCs.

Study materials

Literature

• https://www.techrxiv.org/ndownloader/files/28864056/1

Software

• https://github.com/Ehsan-aghapour/ARMCL-Pipe-All

• https://github.com/Ehsan-aghapour/Governor_Demo

Objectives

• The students can setup an embedded development environment in terms of both hardware and software. The students can then compile and execute an embedded application on an embedded development board.
• The students can do a detailed power-performance analysis of a state-of-the-art embedded application executing on a state-of-the-art embedded Heterogeneous Multi-Processor System on Chip (HMPSoC).
• The student can design an algorithm to optimize the power-efficiency of an embedded application on the given embedded platform. The students can then implement their algorithm as an Operating System (OS) sub-routine.
• They can evaluate the efficacy of their sub-routine in minimizing power consumption alongside an overhead analysis.

Teaching methods

• Hoorcollege
• (Computer)practicum
• Presentatie/symposium
• Zelfstudie

Lecture: Gives students an idea about the embedded systems, the problem they are addressing, and the hardware/software involved. This lecture will impart all the knowledge needed to get started with their practical assignment.

Practicals: Students will work with state-of-the-art embedded development boards. They will get first-hand experience of working as an embedded software developer.

Presentation: Students will give a presentation about their observations and results. The presentation will give them a chance to improve their public speaking skill alongside giving vital experience in doing a technical presentation.

Self-Study: Students will have to understand the existing cutting-research work themselves, and learn how to apply (extend) it.
 
 

Learning activities

Attendance

Programme's requirements concerning attendance (OER-B):

• For practical trainings and tutorials/seminars with assignments attendance is, in principle, obligatory. When students do not meet the requirements for attendance, this may lead to not finishing a course with a pass mark.
  

Additional requirements for this course:

Participation in all the practical sessions is obligatory.

Assessment

The final grade will between 0 - 10. The final grade of the project should be 5 or higher to pass.

The grading will involve a Environment Demo (1 Point), Power-Performance Characterisation Report  (2 Points), Governor Report (2 Points),  Governor Demo (2 Points), and a Competition (Upto 3 Points).

Inspection of assessed work

Students can use the lab sessions to ask questions about the upcoming assignments and request feedback on previous graded assignments.

Assignments

All weekly assignments has to be done in a group and graded.

Feedback will be given over Canvas and in-person in the practicum sessions.

All assignments are graded.

Fraud and plagiarism

Over het algemeen geldt dat elke uitwerking die je inlevert ter verkrijging van een beoordeling voor een vak je eigen werk moet zijn, tenzij samenwerken expliciet door de docent is toegestaan. Het inzien of kopiëren van andermans werk (zelfs als je dat hebt gevonden bij de printer, in een openstaande directory of op een onbeheerde computer) of materiaal overnemen uit een boek, tijdschrift, website, code repository of een andere bron - ook al is het gedeeltelijk - en inleveren alsof het je eigen werk is, is plagiaat.

We juichen toe dat je het cursusmateriaal en de opdrachten met medestudenten bespreekt om het beter te begrijpen. Je mag bronnen op het web raadplegen om meer te weten te komen over het onderwerp en om technische problemen op te lossen, maar niet voor regelrechte antwoorden op opgaven. Als in een uitwerking gebruik is gemaakt van externe bronnen zonder dat een bronvermelding is vermeld (bijvoorbeeld in de rapportage of in commentaar in de code), dan kan dat worden beschouwd als plagiaat.

Deze regels zijn er om alle studenten een eerlijke en optimale leeromgeving aan te kunnen bieden. De verleiding kan groot zijn om te plagiëren als de deadline voor een opdracht nadert, maar doe het niet. Elke vorm van plagiaat wordt bestraft. Als een student ernstige fraude heeft gepleegd, kan dat leiden tot het uitschrijven uit de Universiteit. Zie voor meer informatie over het fraude- en plagiaatreglement van de Universiteit van Amsterdam: www.student.uva.nl

Course structure

Honours information

You must win in the competition to recieve the highest grade(s).

Additional information

You must bring a laptop running Ubuntu (preferably Ubuntu 20.04) to participate in this lab. It is not possible to do the lab using any other OS.

Contact information

Coordinator

• dr. ing. Anuj Pathania

Docenten

• A. Pathania
• E. Aghapour