Last month, Nvidia unveiled an ambitious new plan to increase the efficiency of data center operations and usage. By 2027, they want to raise the maximum number of graphics processing units (GPUs) per system, from 72 now to a staggering 576. This ambitious move takes on the massive and growing demand for computational power. It aims particularly to integrate the transformative fields of artificial intelligence and machine learning. The announcement further reflects the tech giant’s ambitions to continue being at the forefront of high-performance computing.
Point2 and the Korea Advanced Institute of Science and Technology (KAIST) recently joined forces for an innovative international collaboration. They have now published their results in the IEEE Journal of Solid-State Circuits. The project focuses on developing innovative solutions using 28-nanometer CMOS technology, which is crucial for enhancing chip performance and efficiency.
One of the main technical hurdles that the academic researchers have to overcome is the delicate positioning of optical fibers onto the waveguides on photonic chips. As with everything we are doing here, to enable the best data transmission possible, we need to make this process micrometer accurate. Significant losses in signal quality can occur even with small misalignments.
Advancements in Chip Manufacturing
Point2 is soon to start production of those complex chips that will be running under the new 1.6-terabit-per-second cable blazing ahead. This cable consists of eight slender polymer waveguides, each capable of carrying 448 gigabits per second across two frequencies: 90 gigahertz and 225 GHz. With advanced fiber optic network technology, Point2 is set to revolutionize data transmission through today’s data centers. This innovation will provide faster speeds and more efficiency.
The terahertz regime, between 300 to 3,000 GHz, is the last frontier and highest frequency reachable electronically. Point2’s innovations in this regard are a huge step forward in the technology of data transmission.
“You start with passive copper, and you do everything you can to run in passive copper as long as you can.” – Don Barnetson
The Future of Optical and Electronic Integration
Nvidia and Broadcom have both recently released optical transceivers that are built directly into the same package as their processors. This action happens at a historic moment when optical and electronic technologies wrestle for hegemony between these technologies. This seamless integration reduces time to prototype and increases overall efficiency, making it one of the most important inventions in chip design and manufacturing.
Our good friend Don Barnetson, of Credo, has pointed out an exciting new development. They’ve created an Advanced Energy Converter (AEC) that’s capable of 800 Gb/s at 7-meter distances. This exciting new technology is ramping up the capabilities of data centers — equipping them to more quickly process and transmit data.
While customers flood towards the optic, pros say there is a dark side to photonics. Dave Welch reminds anyone who will listen that customers overwhelmingly approve the benefits of fiber. Still, many are hesitant due to the perceived intricacies of optical technologies.
“Customers love fiber. But what they hate is the photonics.” – Dave Welch
Welch notes that electronics have historically been more reliable than optical solutions. He suggests that if designers were not constrained by optical wavelengths, they would explore alternative methods for improving data transmission.
“Electronics have been demonstrated to be inherently more reliable than optics.” – Dave Welch
Efficiency and Performance Gains
Point2’s newly patented e-Tube cables provide an unparalleled form of innovation that can redefine data transmission across the world. These cables draw only one-third of the power needed by conventional optical solutions at one-third the cost. In addition, they provide latency that is one-thousandth latency of what optical cables provide. This outstanding performance has made them a popular option for organizations looking to improve their data center efficiency.
These e-Tube cables are made up of eight fibers, with each fiber transmitting more than 200 gigabits per second. These cables occupy the same space of a 32-gauge copper cable. Even with this smaller footprint, they provide an astounding reach that can be up to 20 times more than conventional alternatives. Welch foresees the waveguide technology allowing data transmission distances of up to 20 meters without loss of signal integrity.
“It’s the only nonredundant hop in the network.” – Don Barnetson
Data centers face an ever-increasing need for speed and efficiency, and with that comes the need for innovation. Innovations like those of Point2 and our other partners will be essential in defining the next era of computing technology.