Lynx
ReleasedLightweight RAG that runs on CPU only
Runs onCPU only
UseQ&A over internal documents
Size0.8B (0.67 GB)
Score93.8 (a 120B model: 97.5)
CatsAI builds small LLMs made for one job only. Because they are small, they run on ordinary CPUs. And that means you no longer need these three things.
Runs on the CPUs in the servers and PCs you already have.
Your costs don't grow with the number of calls.
The model runs in-house or on the device.
For reference: the Lynx model file is 0.67 GB (0.8B, Q4_K_M).
You want to bring in AI, but the project stalls. We hear three reasons again and again. With a small model, here is how each one changes.
API feescan't be predicted.
API fees
don't exist.
It runs on your own CPUs, so costs don't grow with the number of calls.
Internal documentscan't leave the company.
Internal documents
never leave the company.
The model runs in-house or on the device. Your documents stay inside.
A GPU serverisn't in the budget.
A GPU server
isn't needed.
We build to a size that runs on the servers, PCs and phones you already have.
We publish the weights for Lynx, Noir, Serval and Ocelot. Download them and try them as they are on your own PC or phone. If you like what you see, we will build a model for your use case the same way.
ReleasedLightweight RAG that runs on CPU only
Runs onCPU only
UseQ&A over internal documents
Size0.8B (0.67 GB)
Score93.8 (a 120B model: 97.5)
ReleasedBlacks out only the PII
Runs onCPU only
UseMasking text
ReleasedUltra-light translation that runs on a phone
Runs onCPU only, no internet
UseTranslation (10 languages, 90 directions)
Size1.8B (1.1 GB)
Score86.7 (a 120B model: 87.9)
ReleasedText-to-speech that runs on a phone working name
Runs onPhones, even with no signal
UseReading text aloud (TTS)
* The animations above are samples played back from a script (no model is running on this page). For the real thing, download the weights and try them. The sample texts and names are fictional.
Type in the cells on the left. Your text is copied to the cells on the right, and only the cells with personal information turn black. It is a sample of the job Noir does. To try the real Noir, download the weights and run it yourself.
* This box is a sample of the behavior. It is reproduced with simple rules; no actual model is running. Nothing you type is sent anywhere. All names, phone numbers and addresses are fictional.
| Cloud API | Your own GPU server | CatsAI small model | |
|---|---|---|---|
| Cost | Grows with usage | GPU purchase and upkeep | A fixed price set up front provisional |
| Where data goes | Outside the company | In-house | In-house or on the device |
| Hardware needed | None (connection required) | GPU server | The CPUs and phones you have |
| If the connection drops | Stops | Keeps running | Keeps running |
| What it can answer | Broad. Ask anything | Depends on the model | Only the chosen use |
| Time to get started | Right after signup | Procurement and setup | Build time needed |
The bottom two rows (the outlined cells) are where CatsAI is at a disadvantage. If you need a general-purpose AI right away that you can ask anything, a cloud API is the better fit. Small models come into their own when the use is decided and you want to keep costs and data in your own hands.
We ask what you want to use it for and what data you have on hand.
We build small with a little data and check the accuracy in numbers.
We train the model for your use case and slim it down until it runs on a CPU or a phone.
We also build the business system that runs the model, all in one.
Cost and schedule are set and fixed in the first conversation. contract terms are provisional
CatsAI is a company with years of business-system development behind it. We have only just started building small LLMs, and we don't yet have customer deployments we can make public.
What we won't do is hand over a model and call it done. We connect it to the systems you use today and stay on until it is running in the field. And we show you the accuracy in numbers at the prototype stage.
We have only just started building small LLMs, and we don't yet have customer deployments we can make public. Instead, we publish the weights of the models we have built. Run them yourself first and check the accuracy and speed. On a custom build, too, we show you the accuracy in numbers at the prototype stage.
Anyone can download the weights for Lynx, Noir and Ocelot and try them. For the terms of business use, please check each model's license. licenses are provisional
How training data is handled is decided in our first conversation. If your data can't leave the company, we will propose a way to proceed. wording is provisional
The delivered model runs in your environment, and you are the one running it. contract terms are provisional
We decide on the target hardware first, to match your use case and the speed you need, and then build for it. measured figures coming
Serval, our translation model, supports 10 languages, including Japanese, English, Chinese and Korean. Other languages can be added with fine-tuning (Croatian is one we added later).
Tell us what you thought of the released models, or just ask "could this work for our use case?" Nothing is charged until you agree to a quote. provisional
Talk(This is a demo; sending is a mock)