Self Hosting LLMs with Llama.cpp and Unsloth
Progress in AI is moving forward at a blistering pace. It seems like everyday there is a new model with more parameters doing things that we have never seen ...
I am currently a Senior Software Engineer at New Balance specializing in DevOps & Platform Engineering for ecommerce. In my free time, I enjoy skiing, running, drinking coffee, and solving the New York Times crossword.