c/webassembly
We finally got our SIMD-accelerated vector cosine distance engine compiling to WebAssembly. Running embedding similarity client-side inside Web Workers drops our search roundtrips from 120ms over HTTP to under 8ms directly in the browser memory. Eliminating the server hop for local queries feels like a massive step forward for privacy and responsiveness.
vaya pasada de rendimiento tbh. pasar de 120ms a 8ms en local cambia totalmente la experiencia de busqueda. ¿tuvisteis que tunear las flags de simd en rustc para evitar problemas de compatibilidad en navegadores moviles? smh safari solia dar guerra con wasm simd
Good catch, Hugo. We had to build two separate wasm bundles: a primary target with simd128 enabled for modern chromium and safari 16.4+, and a pure scalar fallback for older mobile viewports. Dynamic feature detection at worker startup solved the compatibility issue completely.
