From Vanilla Transformer to FlashAttention: A Quantum Leap in GPU EfficiencyIntroductionOct 10, 2023Oct 10, 2023
A Beginner’s Guide to Understanding Transformer…Before we dive into the world of Transformers, let’s talk about Recurrent Neural Networks (RNNs). They were like the superheroes of AI when…Sep 27, 2023Sep 27, 2023
Overcoming Challenges and Revolutionizing the AI Industry: My Internship ExperienceI was eager to discover the enormous array of AI models and their real-world applications as I began a four-month internship in the field…May 1, 2023May 1, 2023
Parallel Tree Order FinderData placed in tree nodes are aggregated according to the structure of the tree to which they belong using tree accumulation. Aggregation…Dec 9, 2022Dec 9, 2022
