Integrating with Hyperbolic: Providing the AI Coprocessor for Karak

August 23, 2024 by Karak

Hyperbolic

Karak is thrilled to announce its collaboration with Hyperbolic, integrating their advanced AI coprocessor and Proof of Sampling (PoSP) network into Karak’s Distributed Secure Service (DSS) framework. This partnership aims to strengthen the security, scalability, and privacy of decentralized systems on Karak’s universal, verifiable cloud.

Hyperbolic: The Leading Open-Access AI Cloud

Hyperbolic is committed to making AI technology universally accessible, enabling individuals and communities to innovate and progress. Hyperbolic tackles three critical challenges in the AI landscape:

System Scalability: Aggregating global GPU resources to maximize performance and efficiency for various AI tasks.
Verification: Ensuring that AI outputs are generated by the correct models, maintaining the integrity of results.
Privacy: Protecting user data, even when processed by third-party nodes.

What is Karak’s Distributed Secure Service (DSS)?

Karak’s Distributed Secure Service (DSS) is a decentralized framework that leverages restaked assets to enable secure and scalable services. This framework is designed to be flexible, extensible, and scalable, making it suitable for a wide range of applications, from basic utilities to complex AI-powered systems.

Hyperbolic’s PoSP Network

Hyperbolic is developing a DSS for its PoSP network on Karak, enhancing the security and efficiency of decentralized systems, including AI, blockchain rollups, and data availability networks. PoSP employs a game-theoretic approach that incentivizes participants to act honestly, ensuring reliable and verifiable outcomes.

How the PoSP Network Works

The first iteration of the Restaked Proof of Sampling Network will focus on securing Hyperbolic’s AI coprocessor on Karak. Think of this as setting up a robust, multi-layered security system to protect and verify that AI operations are running smoothly and without issues. The network operates with two key entities: a central coordinator and a group of operators.

When an AI task is submitted, the coordinator assigns it to a randomly selected operator using PoSP’s random beacon. After the task is completed, the system may perform a random check by assigning the task to additional operators to verify the results. If there’s a discrepancy, the issue is escalated to Karak’s restaking contract to determine penalties. Future updates will decentralize the coordinator to minimize risks of central control.

Architecture

Hyperbolic Architecture

Workflow Overview

Consumer sends an HTTP request to the coordinator. Requests can also be proxied through a Hyperbolic server to handle billing and credits
Task is forwarded to an operator (we call it executor) selected by the entropy oracle
The operator sends the signed result back to the coordinator
Based on the entropy oracle, the coordinator decides whether to challenge the operator or not and picks operators to regenerate the results the validators
If the challenge path is chosen, the coordinator sends the challenge to the other operator to run the task and sign the result with their BLS key.
The coordinator compares the aggregate signed BLS result and the signed result from the first operator. If the results are different, it sends the results to the slashing contract for arbitration and slashing.

Conclusion

Karak is built for developers by developers. Integrating Hyperbolic on Karak accelerates the vision of universal, verifiable AI for everyone, everywhere. If you want to build on the Hyperbolic DSS, are considering building a DSS, or if you are already building a DSS on Karak, please reach out!

About Karak

Karak is the universal, verifiable cloud platform that makes it easy to provide universal security with any asset on any network, and unlocks a new design space for developers to seamlessly and securely create innovative distributed networks. Karak is designed to be inherently flexible, extensible, and scalable, making it the only platform for any distributed service to be secured with any asset on any network.

Website | X (Twitter) | Discord | Telegram | Documentation

About Hyperbolic

Hyperbolic is the leading open-access AI cloud, building an open ecosystem and economy for AI. Hyperbolic believes in a future where AI technology is universally accessible, empowering every individual and community with the tools to innovate, create, and advance our world. The Hyperbolic founding team is led by award-winning Math and AI researchers from UC Berkeley and the University of Washington.