Uptime Industries Launches Lemony AI - Localized AI Solution

Uptime Industries Introduces Lemony AI: On-Premise AI Infrastructure

Uptime Industries is pioneering a new approach to artificial intelligence deployment with its “AI-in-a-box” handheld device, known as Lemony AI.

This compact device, comparable in size to a standard sandwich, is engineered to execute large language models (LLMs), AI agents, and complete AI workflows on a single unit.

Power Efficiency and Scalability

Each Lemony AI unit requires a mere 65 watts of power for operation, equivalent to the energy consumption of a laptop charger. These devices are designed for stacking and interconnection, enabling the creation of larger, more powerful AI clusters.

According to Sascha Buehrle, co-founder and CEO of Uptime, a single node is capable of supporting an LLM containing up to 75 billion parameters. The system accommodates both open-source models and adapted versions of proprietary models.

Strategic Partnerships

Uptime is initiating its launch with collaborative partnerships with both IBM and JetBrains. These alliances aim to simplify customer access to a diverse range of AI models, including IBM’s closed-source offerings.

Origins and Development

The concept for Lemony AI originated as an internal side project. Uptime’s founders, Buehrle and Ivan Kuleshov, initially investigated the feasibility of distributing language models across Raspberry Pi microcomputers.

While the initial experimentation wasn’t focused on generative AI, its success prompted further investigation into the capabilities of these small computers.

Recognizing the potential of local model execution to drive broader AI adoption, particularly within organizations hesitant to utilize cloud-based solutions, they embarked on developing a dedicated device.

Buehrle explained, “We need to build something small which can go easily into the teams, and which [does] not require any organization-wide decision making.” He emphasized the benefit of bringing on-premise generative AI solutions directly to business teams.

He further noted that clusters of these compact, yet powerful, devices allow for system expansion in alignment with evolving customer requirements.

Demand and Data Privacy

The company reports substantial interest from businesses operating within highly regulated sectors, including finance, healthcare, and legal services.

Data security is a core feature. Buehrle stated, “Everything stays in your box.” This ensures that sensitive data – documents, files, and emails – remains within the device, as models and agents operate locally without external transmission.

Funding and Future Plans

Uptime has secured $2 million in seed funding, led by True Ventures, with contributions from Alumni Ventures, JetBrains, and angel investors. These funds will be allocated to continued device development.

The company intends to adapt its proprietary software, Lemony OS, for compatibility with other hardware platforms, such as the Nvidia DGX Spark.

Furthermore, Uptime plans to broaden the software’s functionality from its current single-user focus to support collaborative team environments.

Pricing and Access

Access to Lemony AI is available at a cost of $499 per month, supporting up to five users.