Prashant Pandey

• Dynamic Vision Transformer that is 2.27 times faster than the standard Vision Transformer, adapts resolution at inference to switch between high and low resolution, trained on the CIFAR-10 dataset; no changes to be made in training and architecture. github
• Knowledge Distillation Library for pytorch based on the papers: distilling knowledge in a neural network, paying more attention to attention: improving the performance of cnn via attention transfer and hidden state distillation; trying to reach on par with state of the art. github
• Paper Replication from scratch in pytorch, implemented autoencoders, knowledge distillation , vision transformer, activation functions, and presently on the complete deepseekv3 architecture. github
• Ray Tracer that I built to learn the math behind it; in just 99 lines of python, a CPU first ray tracer without acceleration that can render 3D models using triangle intersection and shading, resource I used to build it is the ray tracing in one weekend book. github