I鈥檝e been using WebAssembly aka WASM for a while in production to do some incredible stuff in the browser, things that would be prohibitive in terms of performance otherwise. Here are some real use-cases I鈥檝e used WASM for: Running statistical processing 10 million rows (roughly 50 columns in each row) of CSV data in browser. This feature required us to create a temporary playground of reports generated for our clients where they could run their own analysis without the need of permanent storage or costly servers....
In this series we are on a mission to build our very own desktop native app that can interface with LLM LLaMA3-8B over text and audio instructions. In our pervious installment of the series we did our setup with Tauri 2.0 Beta and loaded our LLaMA3 and Whisper models using Huggingface Candle framework, then we ran our text generation pipeline. In this post we complete this journey with voice instructions and get our app to respond to our audio instructions....
In my previous series Desktop QA Assistant With Llama3 in Rust we built a desktop app capable of interfacing with LLaMA3. In this post, we鈥檒l extend the modality of the app to accept audio instructions instead of just text. In this part of the series, we鈥檒l deal with the setup, loading the models and get our text inference up using the rust ML framework called Candle. The series: Part I: The Setup (this post) Part II: Audio instructions and the App Who is this for?...
In this series of posts, we have been building a desktop application to interface with LLaMA3. We did our setup in Part I and built our app鈥檚 backend in Part II. In part III and last part of this series we are going to build a simple client interface with SvelteKit and run our desktop application. Recap If you have landed strait into this post, I鈥檇 highly recommend you take a quick peek into the last 2 parts (links below) to help you get up to speed with the progress....
In the spirit of AI for everyone we started building quick desktop application to interface with the very capable LLaMA3 8B model by Meta AI in our previous post. The series: Part I: The Setup Part II: The model (this post) Part III: Putting it all together Goals We completed the basic setup in our previous post. In this part of the series, we鈥檒l load the model and run our first AI inference....