Product Introduction (Applications and Features)
The Wormhole is Tenstorrent’s current-generation AI inference processor, featuring 72 Tensix cores, 108MB of on-chip SRAM, and 12GB of GDDR6 memory per chip. It achieves an impressive 262 TFLOPS of compute performance at FP8 precision. Dual-chip models offer a combined 128 cores, 24GB of memory, and approximately 466 TFLOPS of processing power. Product configurations include the single-chip “Wormhole n150” and the dual-chip “Wormhole n300,” with prices ranging from $1,099 to $1,449.
Blackhole, the successor to Wormhole, is a next-generation model that incorporates 120 cores per chip (architecturally up to 140 cores) and is available as PCIe cards (p100a, p150a/b) with 28GB or 32GB of GDDR6 memory. Its compute performance at FP8 precision reaches up to 664 TFLOPS. The pricing for Blackhole ranges from $999 to $1,399.
Both products are designed to allow direct, high-speed interconnection between multiple cards using QSFP-DD. This structure provides the flexibility to integrate cards and scale out compute performance and memory.
Support Services (Unique Support and Certification Acquisition Assistance)
ABC Corporation’s commitment extends beyond merely supplying hardware. The company provides comprehensive technical support, including fine-tuning firmware not covered by Tenstorrent’s official support, optimizing operating environments, and preparing technical documentation for the Japanese market. This tailored assistance aims to meet specific customer needs.
Additionally, ABC Corporation offers support services for obtaining the “Productivity Improvement Requirement Certificate for Management Capability Enhancement Equipment” under the Small and Medium-sized Enterprise Management Enhancement Act. This certificate is essential for receiving tax incentives when investing in these chips as capital equipment. The company assists with the necessary document preparation and application procedures. It is important to note that this certification support does not apply to cases where the equipment is not directly utilized by the company (e.g., introduction by rental operators).
Benefits of Adoption
Adopting “Blackhole” and “Wormhole” through ABC Corporation is expected to provide users with several key advantages:
-
High Cost-Performance: Blackhole (up to 664 TFLOPS) and Wormhole (up to 466 TFLOPS) offer an excellent price-to-performance ratio compared to other high-end AI accelerators. With PCIe card prices kept in the low $1,000s, these chips contribute to reducing initial deployment costs, especially for standalone or small cluster applications.
-
Flexible Scalability: Both products support high-speed communication via QSFP-DD, allowing multiple cards to be directly interconnected. This enables linear expansion of processing power and memory capacity. Furthermore, due to the core architecture of Blackhole and Wormhole, it is possible to infer multiple AI models in parallel on a single card.
-
Large Language Model Compatibility: Wormhole and Blackhole support the simultaneous execution of Large Language Models (LLMs), with documented instances of multiple 70B models being inferred concurrently. This capability facilitates multi-user simultaneous request processing and applications in multi-task AI services.
-
Open Software Stack: These products are compatible with Tenstorrent’s open-source software stack (TT-Buda, TT-Metalium), enabling the execution of models developed with PyTorch and ONNX. However, the software is still maturing and undergoes continuous improvements.
Future Outlook
ABC Corporation aims to further contribute to the advancement and widespread adoption of AI infrastructure in Japan through the provision of these product lines. Looking ahead, the company plans to expand its product lineup by considering the domestic introduction of Tenstorrent’s next-generation chips. Leveraging its expertise in AI and cloud software development, ABC Corporation will continue to support customers’ DX (Digital Transformation) and enhance their competitiveness by integrating cutting-edge AI hardware with software solutions.
Contact Information
Company Name: ABC Corporation
Website: https://www.abckk.dev
