Amazon launched the open-source tool TorchNeuron, lowering the threshold for transitioning to self-developed chips

Financial Associated Press, October 20 - Amazon launched the open-source tool TorchNeuron on the 19th local time, aiming to lower the barrier for developers to transition from NVIDIA chips to its self-developed chips, challenging NVIDIA's software barrier built on CUDA. According to reports, this tool allows AI code written in PyTorch to run on Amazon's self-developed AI chips without the need for rewriting. PyTorch is maintained primarily by Meta and is described as an open-source framework used by most AI developers.

Amazon's chip design department, Annapurna Labs, introduced that with TorchNeuron, developers only need to modify one configuration to run the same code on the self-developed Trainium chip. Amazon announced the launch of this tool on the 19th local time and plans to publicly release it in a free open-source format at the PyTorch conference in San Jose, California on the 20th.

Colin Brace, Vice President of Software at Annapurna Labs, stated in an interview that the launch of TorchNeuron is intended to reduce the steps required for developers to try Amazon's self-developed chips, starting from the customers' existing workflows. He revealed that over 30 early customers are already using it, covering fields such as robotics, world models, and voice AI, and mentioned that switching to Amazon chips can save costs.