Local AI: Gemma, DeepSeek and open-weight models

When AI must stay inside the company

Not all data can — or should — leave the company perimeter. Documents covered by professional secrecy, health data, sensitive industrial information, contexts with strict data sovereignty requirements: for these scenarios Lekton.AI designs and manages local AI solutions, with open-weight models running entirely on the client’s infrastructure, on-premise or in a private cloud.

The models we use

We work with the best open model families available, including Gemma by Google — compact, efficient models, ideal when hardware resources are limited — and DeepSeek, which brings advanced reasoning capabilities to the open-weight world. The choice of model is never ideological: it depends on the task, the language, the available hardware and the quality requirements. For every project we evaluate and measure the alternatives on the client’s real use case, sizing the infrastructure accordingly.

What “managing” local AI means

Running a model is the easy part. The value lies in everything else, and that is what we provide: hardware sizing and model quantisation for the best performance/cost ratio, serving with response times suited to business use, integration with existing document systems (including fully local RAG pipelines, where even the embeddings and the vector index stay in-house), controlled model updates and quality monitoring over time.

Hybrid architectures: the best of both worlds

In practice, the most effective solution is often hybrid: frontier models in the cloud — such as Claude, our flagship technology — for the most complex analyses on data that can be processed in the cloud in compliance with the GDPR, and local models for data that must not leave the perimeter or for high-volume tasks where the cost per call matters. We design the routing architecture that decides, data point by data point and task by task, where the processing should take place.

Who it is for

Law and notary firms, healthcare, manufacturing with critical intellectual property, public administration, and in general any organisation that wants the benefits of generative AI while keeping full control of its data and its costs.


Want to find out whether local AI is the right path for your organisation? Contact us for an assessment.