Local AI#classifiers
What to check before running Cloudflare Clef at home
Open weights make Clef worth investigating for local automation. The hardware and software deserve a closer look before you buy anything.
Cloudflare’s Clef is worth a look if you’re building software that needs to sort information or choose its next step. The company released Clef and Clef-Flash on October 1 with downloadable weights under Apache 2.0. You can investigate them on your own hardware, alongside a hosted option on Workers AI. Cloudflare’s announcement
For a home setup, start with the job you want done. Suggesting categories for a folder of public manuals is a sensible experiment. Buying a new computer because a model tops a leaderboard is harder to justify. We haven’t tested Clef on home hardware, so this guide explains what to check first.
Give it a question with clear answers
Clef takes some information and a set of typed questions, then scores the allowed answers. The official model card describes a 27-billion-parameter model that accepts text, structured data, images and video. Its decision output contains probabilities rather than a written explanation. Clef model card
Think about a small collection of equipment manuals. You could ask whether each document concerns networking, home automation, workshop tools or something else. Your application would save the suggested category beside the filename, leaving the original alone. That’s a proposed use, not an integration we’ve verified.
The labels matter. A manual for a Wi-Fi-enabled table saw could reasonably fit two categories. Decide how you want to handle that before blaming the model for an answer you never defined clearly. Our classifier explainer covers this starting point in more detail.
Check the hardware before the download
Clef-Flash is the smaller, 9-billion-parameter option. Its card lists BF16 weights and a tested setup using PyTorch 2.11, Transformers 5.10.2 and a single NVIDIA H200. That describes the publisher’s test environment; it does not establish the cheapest supported computer. Clef-Flash model card
The sizes deserve attention. At two bytes per parameter, 9 billion parameters come to roughly 18 GB and 27 billion to roughly 54 GB. These are rough weight-storage calculations in decimal gigabytes, not measured RAM or VRAM requirements. Loading the model, processing inputs and running the rest of your software need additional resources.
A compressed version, called a quantization, may change the calculation, but confirm that it preserves Clef’s decision behavior and runs in your chosen software. Don’t assume that fitting the backbone weights means the complete application will work. For now, we have no measured basis for recommending a particular mini PC, Mac or graphics card for Clef.
Use the documented decision interface
Cloudflare’s local example loads a custom schema head alongside the backbone and uses the supplied joint_schema_model code. That extra head scores the permitted answers. This is why a generic chat-model loading example, or a familiar model name in an app, is insufficient evidence of full Clef support. Follow the publisher’s actual decision-model example. Local usage and files
Also check limits for the route you use. The local cards document a default encode_record limit of 16,384 tokens, while the hosted Clef page lists a 65,536-token context window. The hosted API warns that long text is truncated to fit. A hosted specification should not become a promise about a local configuration. Local input format · Workers AI documentation
For a first attempt, use short text and follow the documented loading and decision-API example, after checking that your available hardware can run the complete model. Record the model revision and dependency versions. Confirm that all required files are downloaded before disconnecting the network. Keep a local test service accessible only from the machine running it until you have a reason and a plan to expose it.
Make it earn your trust on a small job
Cloudflare publishes an internal Decision Index evaluation and separate workflow results. Those tables use different measures for different tasks. A strong result on one benchmark is a reason to investigate, not a household accuracy rating. We haven’t reproduced the results. Published evaluation
A probability needs checking too. A well-calibrated classifier should get roughly 80 percent of comparable predictions right when it assigns them 80 percent confidence. Producing a decimal does not establish that calibration. The scikit-learn calibration guide explains the distinction.
Here’s how we’d approach the manuals example:
-
Choose a small set of categories and include an other or needs-review option. Write down what belongs in each category.
-
Label a manageable batch yourself. Include unclear titles, mixed subjects and documents outside the intended categories. A few dozen examples can reveal obvious problems, although they cannot establish a dependable error rate.
-
Run the same examples through a simple filename or keyword rule. Compare whether Clef fixes enough mistakes to justify the extra setup and compute.
-
Inspect wrong answers and their confidence. Rephrase a question and change the order of the options. Include text that tries to instruct the classifier to choose a label.
-
After adjusting the setup, check fresh examples you didn’t use to tune it. Measure total processing time, including loading and text extraction, as well as the number of suggestions you need to correct.
Keep the output as suggestions while you learn. A mistaken category is easy to fix when nothing has been moved or deleted. The same confidence score should never grant permission to run commands or change access to files.
Decide whether local operation is worth the work
Workers AI gives you a hosted route if you want to try Clef without arranging the local runtime. That sends the supplied information to Cloudflare and introduces a service dependency. Check the current usage terms and charges before putting real workloads through it. Hosted Clef
Local operation can give you more control over where the model runs, but privacy depends on the whole application. External text extraction, logging or cloud fallback can still send information elsewhere. Start with public sample documents while you establish what your setup actually does.
Clef belongs on the list of tools to evaluate when you already have a specific classification job. If you’re still looking for the job, begin with your existing computer and a simple rule. Spend on hardware after you can explain which mistakes Clef prevents and how much useful work it saves.
Research note: Documentation checked October 9, 2026. This article reports published specifications and proposes an evaluation approach. We did not run Clef, reproduce its benchmarks or verify performance on consumer hardware. Links are ordinary source links; this article includes no affiliate or sponsored placement.