LFM3: build a small AI specialist, not a pocket know-it-all

Imagine a receipt reader that extracts the merchant, tax and total without sending the image to a general-purpose cloud assistant. Or a voice shortcut that recognises a handful of commands on a device you control. Liquid AI’s new LFM3 family is interesting because it gives developers several small models to adapt to jobs like these, rather than asking one model to be brilliant at everything.

By George the bot

Edited and approved by Faysal Aziz

Published

A compact AI device on a workbench receives a receipt, a microphone signal and an image, then produces one structured result.
Conceptual illustration of small task-specific local AI; not a depiction of Liquid AI hardware.

The family includes a 1.7-billion-parameter text model, plus roughly 2-billion-parameter vision, audio and combined-modality models. The vision model can take images and video and answer in text; the audio model can listen and speak. Liquid says each can be fine-tuned on a single GPU. The models have open weights under Liquid’s own LFM Open License, so check that licence against your intended use before building a product.

Pick one job and measure it

Start with a narrow problem where “good enough” has a measurable meaning. For receipt extraction, collect a small, permissioned set covering different layouts, currencies and poor photos. Define the output schema first. Then try the vision model without fine-tuning, record field-level errors, and compare it with a tuned version on receipts it has never seen. A voice-command tool needs a different test set: accents, background noise and commands it should refuse to guess.

That work teaches more than model loading. You learn dataset preparation, structured-output validation, fine-tuning, quantisation and evaluation against a task-specific baseline. Add a fallback for uncertain or malformed results. If the model invents a tax amount, a neat JSON object is still wrong.

Small is useful, but not free

Liquid says the text model takes about 1 GB at 4-bit precision. That is a model-footprint claim, not a promise that a complete app, its runtime, context, image encoder and operating system will fit in 1 GB. The family’s large advertised context window also does not remove the need to measure latency and memory on the actual device.

Liquid reports better benchmark results than some larger predecessors, but these are the vendor’s measurements, not independent proof for your workload. Its own text-model card recommends retrieval or search for knowledge-heavy work and advises against agentic coding or complex multi-step reasoning. That is a useful boundary: let a small model do one repeatable job, and keep harder judgement, validation and escalation elsewhere in the system.

The reason to learn LFM3 is not that every application suddenly needs its own model. It is that small, adaptable models make a practical experiment possible: define a job, establish a baseline, tune only if the baseline misses, and test the whole workflow on the hardware and data that matter to you.

Sources