top of page
Search
Writer's pictureNithin P Gukhool

The Blackwell AI chip and the NPU

Updated: May 28

 


The Blackwell AI chip


NVIDIA’s founder Mr J. Huang has been in the news recently for his innovative work in the domain of AI chips.  AI models have become increasingly data-intensive and they are limited by the computational resources required to train and deploy them.   In comes the Blackwell AI chip…! The Blackwell AI chip is a new state-of-the-art chip that has been made specifically for trillion parameter AI models.  The latter are powerful models that can process and analyze vast amounts of data.  However, they were being limited by computer hardware.


NVIDIA has come up with the Blackwell chip in order to address these challenges.  The Blackwell chip offers an array of performance improvements for trillion parameter AI models. Its features include enhanced memory data retrieval and energy efficiency.  It has a completely revamped hardware or motherboard and will also need a new manufacturing process.  NVIDIA is making the Blackwell chip available on the cloud in order to optimize services such as Microsoft 365, Amazon, OneDrive, Oracle, Azure and so many others.  It has also partnered with Apple in order to optimize the Apple Vision Pro.




The NPU


The Blackwell AI chip is a hardware accelerator that improves training and performance and this paves the way for AI applications such as drug discovery, climate modelling, personalized medicine and autonomous driving.  Another noteworthy invention in the domain of AI chips is the NPU or Neural Processing Unit.  An NPU is a dedicated processor or processing unit on a larger SoC (System on a Chip), designed specifically for neural networks and AI.  A system on a chip (SoC) is an integrated circuit or board that combines most or all of a computer's electronic components onto a single package. SoCs are often used in smartphones, laptops, tablets, and smart home devices. The NPU has been modelled according to the human brain and offers enhanced computer processing capabilities for AI applications. While CPUs handle a broad range of tasks and GPUs excel in rendering detailed graphics, NPUs specialize in executing AI-driven tasks swiftly. 


Kolmogorov Arnold Networks.


  Another recent significant milestone in the development of AI models has been reached and this is the Kolmogorov Arnold Network or KAN.  A breakthrough alternative to traditional multi-layer perceptrons (MLPs) has come to the forefront, changing the landscape of artificial neural networks. Known as Kolmogorov-Arnold Networks (KANs), this innovative architecture presents a novel learning approach to function approximation.


One important application of KANs is time-series forecasting. Time-series data are used to forecast trend using current and historical data. One example is following the price of a commodity over time. Following this change is important to imformed decision making in economic planning and one would want to predict this change based on available data. Hence, a time-series forecast is employed.


Quite a few industries are utilizing time-series forecasting and these include business planning, control engineering,  cyptocurrency trends, financial markets, statistics and weather forecasting.


Jai Sri Krishna!


By KLP (May 25, 2024)


Article references : -


R. Reddy (LinkedIn)


Image credits: Bing



Lord Kalki: Divine avatar for this age


The Guru: His Divine Grace A.C Bhaktivedanta Swami Prabhupada

39 views0 comments

Recent Posts

See All

留言


bottom of page