Posts

LoRA-Whisper: A Scalable and Efficient Solution for Multilingual ASR

Exploring LoRA-Whisper, a scalable and efficient approach for multilingual ASR using Low-Rank Adaptation to fine-tune OpenAI’s Whisper model while avoiding catastrophic forgetting across languages.

Understanding FlashAttention: Inner vs Outer Loop Optimization

FlashAttention is a groundbreaking optimization technique for computing attention in Transformer models, drastically improving GPU memory efficiency through inner vs outer loop restructuring.

Adversarial Attacks on Large Language Models (LLMs)

An overview of adversarial attacks on large language models (LLMs) — how manipulated inputs can deceive models into generating harmful or incorrect outputs, covering key attack types, implications, and defense strategies.

GLiNER: A Generalist Model for Named Entity Recognition using Bidirectional Transformers

A detailed summary of the GLiNER paper, introducing a lightweight, scalable, and highly effective model for open-type named entity recognition using bidirectional transformers with zero-shot generalization.

Handy Bash Snippets and Linux Tips

A curated collection of bash functions, troubleshooting commands, and performance tweaks that I often use in my daily workflow.

Vietnamese Voice Conversion

Overview

Postnet Layer

Generally speaking, the postnet layer receives a mel-spectrogram and predicts another mel-spectrogram with additional information. That makes the output mel-spectrogram more detail, and hence improves the quality of synthesis audio.

KNN-VC vs Phoneme Hallucinator [23/03/2024] ?

Overview

KNN-VC vs Phoneme Hallucinator [09/03/2024] ?

Overview

How to kill zombie processes using GPU ?

The trick for killing zombie processes using GPU in Linux 😃.