Just a few weeks after Chipmaker Tenstorrent raised nearly $700 million, developers can try out Tenstorrent's AI accelerator on Koyeb. Tenstorrent sells AI processors built around the RISC-V instruction set architecture and has developed its own open source neural network library TT-NN, and TT Metalium, an open source low-level programming model.
Tenstorrent is part of a group of companies looking to build alternatives to Nvidia GPUs and the company's CUDA library. It competes with Axelera, Etched, Groq and others.
Founded by former Scaleway executives, Koyeb focuses on developing a serverless cloud platform for developers looking for a layer of abstraction at the cloud infrastructure level. Compete with fly.io, railways, rendering, and more.
After integration with the code repository, Koyeb uses a command line interface or Git push to allow developers to deploy applications to multiple virtual machines. It supports Docker containers and many popular languages.
One of the main features of Koyeb is that it can automatically scale applications to hundreds of servers as needed, and if there is low traffic, it can automatically scale your server infrastructure.
Over the past few months, Koyeb has been focusing on AI apps in particular. The serverless nature of the platform allows for a drop in your AI workload experience.
At the front of the hardware, Koyeb deploys Tenstorrent PCIe boards in the data center. Developers can access TenStorrent's low-level TT Metalium SDK to write host and kernel programs.
Developers will find two new types of instances in Koyeb's documentation and the admin panel.
The TT-N300S instance has 24GB of GDDR6 memory, 192MB of SRAM, and offers up to 466 FP8 TFLOPS. It is paired with 64GB of RAM and four VCPUs. There are four N300s in the TT-Loudbox instance. Developers get 96GB of GDDR6, 768MB of SRAM, and up to 1,864 FP8 TFLOPS. It has 256GB of RAM and 16 VCPU.
With this release, Koyeb is trying to position itself as a hardware-independent cloud platform. “This reminds us of ARM's debut in the server market using high-performance chips,” Koyeb co-founder and CEO Yann Leger told TechCrunch.
“Since providing a fully customized server between 2013 and 2014 and introducing Arm to the market using Scaleway, I have experience deploying a variety of architectures and operating a wide variety of hardware.” he added.
When it comes to TenStorrent, AI Chipmaker is looking for partners to build a developer ecosystem focused on open source programming models. A village is needed to provide an alternative to Nvidia's AI stack.