Model Distillation for Deep Audio Representations
Bachelor thesis investigating how large audio representation models such as BEATs can be distilled into lightweight student networks for deployment on hearable devices.
Lucerne University of Applied Sciences and Arts
As an AI Research Assistant, I have worked on several applied research projects. I contributed to the automatic transcription and summarization of medical consultations, developing the frontend and implementing LLM-based summary generation.
Another project focused on pedestrian detection and tracking in a public square using drone footage. I also developed a complete information-extraction pipeline for processing photos of pension certificates.
My current work continues my bachelor thesis, where I explore distillation of audio tokenizers for deployment on hearable devices. In addition to research projects, I manage 13 GPU workstations and set up and maintain a small Slurm cluster.
V‑ZUG AG
As a Junior Web Developer at V‑ZUG AG, I gained extensive experience in web development using Java, Angular, and Python. Working in a Scrum team, I effectively utilized Git, JIRA, and Confluence. With a strong background in MySQL, Spring MVC, and 3rd Line Support, I contributed to enhancing the company’s web presence.
V‑ZUG AG
During my apprenticeship, I gained insights into IT and software development. From my second to fourth year, I was involved in improving and troubleshooting the V‑ZUG E‑Commerce platform and developing various data exports. In my final two years, I took on the responsibility of mentoring and training apprentices in web development.
Lucerne University of Applied Sciences and Arts (HSLU)
The Master’s profile in Data Science within Information and Communication Technologies at Lucerne University of Applied Sciences and Arts deepens expertise in advanced machine learning and applied research methods. The program focuses on solving complex, real-world problems through project-based work and close collaboration with industry and research partners.
Lucerne University of Applied Sciences and Arts (HSLU)
The Bachelor in Artificial Intelligence and Machine Learning at Lucerne University of Applied Sciences and Arts provides a strong foundation in machine learning, data science, and AI systems, combining theory with hands-on projects. The program emphasizes applied problem-solving, preparing students to design, train, and deploy AI models in real-world settings.
Gewerblich-industrielles Bildungszentrum Zug
Completed an apprenticeship in Application Development at Gewerblich-industrielles Bildungszentrum Zug, earning a Berufsmatura in parallel. Gained broad exposure to software development, covering fundamentals across multiple areas.
I've worked on a variety of projects, from simple web applications to complex knowledge distillation pipelines. Here are a few of my favorites.
Bachelor thesis investigating how large audio representation models such as BEATs can be distilled into lightweight student networks for deployment on hearable devices.
A modular Jass-playing agent combining Determinized Monte Carlo Tree Search, neural trump prediction, and rule-based heuristics. The project evaluates algorithmic tradeoffs, MCTS convergence behavior, and distributed search under real-time constraints, culminating in a competitive tournament deployment.
During my time at university, I completed several project-based modules with concrete deliverables. I like to showcase some of this work here. A few projects are older, and there are many things I would approach differently today, so please don’t be too critical 🙂
AI Competition
For AICOMP, Flora Gashi, Alvin Veliyath and I participated in the BirdCLEF 2024 challenge, classifying bird sounds from the western ghats into 182 species using deep learning. Focused on audio preprocessing, model training, and evaluation.
Deep Learning for Games
For DL4G Dan Livingson and I developed a Jass-playing agent using Monte Carlo Tree Search and a regression neural network for trump selection.
Digital Creativity
A ChatGPT-based assistant for Dungeons & Dragons that generates NPCs, spells, monsters, and magical items. Built before structured output was available, with a strong focus on prompt engineering. Due to OpenAI removing unused balance, the application is no longer functional.