back Back

‘Lightning’ system combines light and electrons to unlock faster, greener computing for machine-learning models

Sep. 13, 2023.
1 min. read Interactions

May also reduce high costs

About the Writer

Amara Angelica

134.28253 MPXR

Amara Angelica is Senior Editor, Mindplex

“Lightning,” a reconfigurable photonic-electronic smart network interface card that serves real-time deep neural network inference requests at 100 Gbps (credit: Alex Shipps and MIT CSAIL via Midjourney)

The growing demand for high-performance computers that can support increasingly complex (and expensive) AI models has led engineers to explore new methods for expanding the computational capabilities of their machines.

Now Manya Ghobadi, an associate professor at MIT’s Department of Electrical Engineering and Computer Science (EECS) and a CSAIL member, and her colleagues have developed a solution: a system (dubbed “Lightning”) that connects photons (produced by lasers) to the electronic components (transistors and wires) of computers—creating hybrid photonic-electronic, reconfigurable network interface cards (“SmartNICs).

First photonic-computing prototype to serve real-time, machine-learning inference requests

The new system allows deep neural networks (machine-learning models that imitate how brains process information) to complete inference tasks (like image recognition and large language models generated in chatbots such as ChatGPT).

Machine-learning services completing inference-based tasks, like ChatGPT and BERT, currently require heavy computing resources and are expensive—some estimates show that ChatGPT requires $3 million or more per month to run.

They’re also environmentally detrimental. Instead, Lightning uses photons, which move faster than electrons do in wires while generating less heat.

The team is currently (Sept. 10–14) presenting their findings at the Association for Computing Machinery’s Special Interest Group on Data Communication (SIGCOMM).

Let us know your thoughts! Sign up for a Mindplex account now, join our Telegram, or follow us on Twitter

Comment on this content

0 Comments

0 thoughts on “‘Lightning’ system combines light and electrons to unlock faster, greener computing for machine-learning models

Like
Dislike
Share

0

Comments
Reactions
💯 💘 😍 🎉 👏
🟨 😴 😡 🤮 💩

Here is where you pick your favorite article of the month. An article that collected the highest number of picks is dubbed "People's Choice". Our editors have their pick, and so do you. Read some of our other articles before you decide and click this button; you can only select one article every month.

People's Choice
Bookmarks