From 'Very Fast' to '~Fastest': Helping rust unleash compiler optimizations

diff-match-patch-rs A few years back, while building HandyTrain, we decided to build a collaborative content creation feature, among other things we needed a text-synchronization library - a WASM version for the client and a high-performance library for our Go and Rust services. With some research we landed on the fantastic diff match patch algorithms, the diff part is an implementation of this paper (often called the Myer’s Diff algorithm) by Eugene Myer’s....

December 31, 2024 · 23 min · 4932 words

Series: Desktop App for Document QA with RAG

A DIY style step-by-step guide to building your own cutting-edge GenAI-powered document QA desktop app with RAG.

September 10, 2024 · 101 min · 21389 words · 5 posts

WASM: The `What`, `When` and `How`

I’ve been using WebAssembly aka WASM for a while in production to do some incredible stuff in the browser, things that would be prohibitive in terms of performance otherwise. Here are some real use-cases I’ve used WASM for: Running statistical processing 10 million rows (roughly 50 columns in each row) of CSV data in browser. This feature required us to create a temporary playground of reports generated for our clients where they could run their own analysis without the need of permanent storage or costly servers....

July 23, 2024 · 16 min · 3503 words

Series: Voice Assistant Desktop App with LLaMA3 and Whisper in Rust

Step by step tutorial on building a desktop app to interface with LLM LLaMA3 with text and audio instructions in Rust.

July 7, 2024 · 45 min · 9516 words · 2 posts

Series: Desktop QA Assistant With Meta LLaMA3 in Rust

Building a desktop native app to interface with a local LLaMA3 8B in Rust using Tauri and Llama.cpp, step-by-step.

June 12, 2024 · 36 min · 7616 words · 3 posts