Even bolder, perhaps, Intel has released an experimental chip called Heracles built expressly for fully homomorphic encryption (FHE) computing workloads. This pioneering technology was on display at the IEEE International Solid-State Circuits Conference (ISSCC) this week in San Francisco. Heracles is increasing processing speeds dramatically. Now, this groundbreaking technology has the potential to change how we work with encrypted data — allowing industries to compute on private data in more secure ways than ever before.
Heracles provides stunning performance boosts to performance. It achieves speeds that are over 5,000 times faster than traditional, state-of-the-art Intel server CPUs on FHE computing workloads. This massive increase in speed would be game-changing for industries that require sensitive data to be processed securely, like finance and healthcare. Heracles enables quick analysis of large volumes of encrypted data. This power is what makes it such a monumental breakthrough in the field of cryptography.
Heracles is designed with 64 compute cores, or tile-pairs, tiled in an 8-by-8 grid. This architecture provides it with superior parallel processing power, equipping it to effectively process complex calculations. This powerful chip takes advantage of the cutting-edge 3-nanometer FinFET process technology. Its clock frequency is 1.2 gigahertz and it rapidly executes core FHE mathematical transforms in just 39 microseconds.
The chip’s architecture includes an innovative liquid-cooled package. This package contains two state-of-the-art 24-gigabyte highbandwidth memory chips, each with 128 megabytes of cache memory. Together, these pieces give Heracles the ability to perform nearly 9.6 terabytes of processing in just a second! It very quickly hops from one tile-pair to another to make this blazing fast speed possible.
Heracles crushes the performance of today’s best Intel Xeon CPUs. It demonstrates a remarkable 2,355-fold speedup, even at 3.5 GHz execution on the Xeon. Live demonstrations at ISSCC demonstrated this fantastic new capability. Heracles performed fully homomorphic encryption tasks 1,074 to 5,547 times faster than a conventional CPU.
Potential Applications
The implications of Heracles are far more than just faster speeds. What it can do is unlock efficient encrypted computing at scale. That makes it uniquely suited to addressing incredibly high-scale tasks, such as fully auditing 100 million voter ballots. Its specialized design and capabilities make it a perfect fit for numerous applications where secure data management is critical.
Kurt Rohloff stated that when Intel commits to scaling this technology it means a lot to the industry. He stated, “When Intel starts talking about scale, that usually carries quite a bit of weight.” Despite the tech community’s low confidence in the statement, this is a positive sign because it shows that Heracles could be very meaningful in encrypted data processing.
John Barrus added, “There are a lot of smaller models that, even with FHE’s data expansion, will run just fine on accelerated hardware.” Heracles is designed for and shines brightest in large-scale, nationwide applications. Further, it’s great at handling the smaller models that require computation to be done securely.
Future of Encrypted Computing
As organizations of all shapes and sizes lean on AI and other advanced technologies to safeguard their data, Heracles is a big leap in that direction. The chip is an answer to the increasing demand for high-end hardware. It is architected for heavy-duty machine-learning tasks such as neural networks and semantic search. Kurt Rohloff noted that “where you start to need hardware is emerging applications around deeper machine-learning oriented operations.”
Sanu Mathew echoed this sentiment, asserting that “Heracles is the first hardware that works at scale.” This quote perfectly captures why this chip is so revolutionary, making it a key breakthrough in how we can approach encrypted computing.
Ro Cammarota expressed confidence in the chip’s capabilities, stating, “We have proven and delivered everything that we promised.” This commitment from Intel’s team is very much in line with their ongoing commitment to research and development of secure computing technologies.
Nick New drew attention to the ambition that underpinned Heracles and its design process. He remarked, “We’re looking at pushing way past that digital limit.” These aspirations are a sign of the enormous promise ahead for whiter, brighter, and lighter encrypted computing technologies.