By info@ico28.com 
The NR1-S, when paired with AI accelerators in an AI inference server, reduces data centre costs by up to 90% and increases energy efficiency by up to 15 times while delivering linear scalability without performance drop-offs or lags as additional AI accelerators are added, according to NeuReality.
Bringing extensive embedded design skills to the project, Arrow’s in-house experts provided firmware and hardware design guidance, and developed and validated power management firmware. Arrow also handled debugging of the microcontroller (MCU) and platform power flows to support the successful NAPU bring-up, NR1-S and integrated NeuReality software – all performed in record time.
The Arrow team also helped select the most suitable MCU to provide the interface crosslink between system components of the PCIe card and server.
The NR1 NAPU is a custom server-on-a-chip that provides the full performance of each dedicated AI accelerator from approximately 30% today to 100% full utilisation – boosting total output and reducing silicon waste. The NAPU not only migrates services including network termination, quality of service, and AI data pre-and post-processing but also improves data flow for the high volume and variety of AI pipelines.
The NeuReality system architecture eliminates the performance bottleneck caused by traditional CPU-centric system architecture relied upon today by all AI Inference systems and hardware manufacturers. As a result, the NR1-S increases cost savings and energy efficiency of running high-volume, high-variety AI data pipelines – a top financial concern in the deployment of today’s power-hungry conventional and generative AI applications.
“Our NAPU addresses the major bottlenecks that restrict performance in today’s AI accelerators, such as power management and transferring data from the network into the AI accelerator, typically a GPU, FPGA or ASIC,” said Eli Bar-Lev, director of hardware at NeuReality. “Arrow’s support with the hardware and firmware for power management and thermal engineering allowed us to focus resources on a complete silicon-to-software AI inference solution which will reduce the AI market barriers for governments and businesses around the world.”
“This exciting project can potentially make cloud and on-premise enterprise AI inferencing more affordable and faster, thereby increasing access to valuable services in healthcare and medical imaging, banking and insurance, and AI-driven customer call centres and virtual assistants,” said Vitali Damasevich, director engineering Eastern Europe and engineering solutions centre EMEA.
Original article source:
FAQ
- What is Arrow Electronics’ role in advanced AI inferencing?
Arrow Electronics provides a range of solutions for advanced AI inferencing, including hardware, software, and support services. They work with various partners to integrate AI capabilities into different applications, offering solutions for edge computing, data centers, and IoT.
- What is NeuReality and what do they offer in AI inferencing?
NeuReality is a company specializing in advanced AI inferencing solutions. They focus on developing high-performance, efficient hardware designed to accelerate AI workloads, particularly in edge and cloud environments. Their technology aims to enhance computational efficiency and reduce latency for AI applications.
- How do Arrow Electronics and NeuReality collaborate?
Arrow Electronics partners with NeuReality to provide their advanced AI inferencing solutions to a broader market. This collaboration allows Arrow to offer NeuReality’s cutting-edge hardware and software solutions as part of their portfolio, helping customers integrate AI capabilities into their systems.
- What are the key benefits of NeuReality’s AI inferencing solutions?
NeuReality’s solutions offer several benefits, including:
– High Performance: Accelerates AI inferencing tasks with optimized hardware.
– Efficiency: Reduces power consumption and improves operational efficiency.
– Scalability: Provides solutions that can be scaled for different applications and workloads.
– Low Latency: Minimizes response times for real-time AI applications.
- How can I integrate NeuReality’s solutions with my current systems?
Integration typically involves working with Arrow Electronics to select the appropriate hardware and software based on your specific needs. Arrow can provide support for integrating NeuReality’s solutions into existing systems, including hardware installation, software configuration, and performance optimization.
- What industries benefit most from advanced AI inferencing solutions?
Industries that benefit from advanced AI inferencing solutions include:
– Automotive: For autonomous driving and advanced driver-assistance systems.
– Healthcare: For medical imaging, diagnostics, and patient monitoring.
– Retail: For personalized shopping experiences and inventory management.
– Manufacturing: For predictive maintenance, quality control, and automation.
– Telecommunications: For network optimization and edge computing applications.
- How can I get started with Arrow Electronics and NeuReality’s AI solutions?
To get started, you can contact Arrow Electronics for an initial consultation. They can provide information on available products, solutions, and services. You can also explore NeuReality’s offerings through their website or contact their sales team for more detailed information on how their solutions can meet your specific needs.