Tag: GPU
DataPelago Unveils Universal Engine to Unite Big Data, Advanced Analytics, and AI Workloads
DataPelago today emerged from stealth with a new virtualization layer that it says will allow users to move AI, data analytics, and ETL workloads to whatever physical processor they want, without making code changes, the Read more…
OctoAI Snapped Up by Nvidia
OctoAI, a Seattle AI startup that allowed users to run a variety of foundation models while shielding them from the complexity of the underlying infrastructure, has been acquired by GPU giant Nvidia. Rumors have swirl Read more…
Faster Interconnects and Switches to Help Relieve Data Bottlenecks
Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at the network layer threatens to make bigger and brawnier pro Read more…
Nvidia Introduces New Blackwell GPU for Trillion-Parameter AI Models
Nvidia’s latest and fastest GPU, code-named Blackwell, is here and will underpin the company’s AI plans this year. The chip offers performance improvements from its predecessors, including the red-hot H100 and A100 Read more…
Nvidia Looks to Accelerate GenAI Adoption with NIM
Today at the GPU Technology Conference, Nvidia launched a new offering aimed at helping customers quickly deploy their generative AI applications in a secure, stable, and scalable manner. Dubbed Nvidia Inference Microser Read more…
How HP Was Able to Leapfrog Other PC/Workstation OEMs to Launch its AI Solution
This month, HP stunned the market with the most powerful line of AI-enabled PCs and workstations yet to be created, catching the other OEMs, which have been more tentative and less complete, by surprise. I was at the lau Read more…
Predibase Launches LoRA Land to Rival GPT-4
Predibase, the leading developer platform for fine-tuning LLMs, has introduced LoRA Land, a collection of 25 open-source fine-tuned models that the company claims can challenge or even outperform the hugely popular GPT- Read more…
The Future of AI Is Hybrid
Artificial intelligence today is largely something that occurs in the cloud, where huge AI models are trained and deployed on massive racks of GPUs. But as AI makes its inevitable migration into to the applications and d Read more…
Voltron Aims to Unblock AI with GPU-Accelerated Data Processing
Data is at the heart of artificial intelligence, but it’s also emerging as one of its biggest bottlenecks. Without sufficient quantities of good, clean data to feed into models, companies simply can’t reap the reward Read more…
Top 10 Challenges to GenAI Success
So you want to implement generative AI? That’s great news! You can count yourself among the majority of IT decision makers who have also seen the potential of this transformative tech. While GenAI has the potential to Read more…
2024 GenAI Predictions: Part One
Something unexpected happened in 2023: the world learned about generative AI for the first time. Now that the GenAI cat is out of the bag, companies are in a race to monetize it without succumbing to its negative aspects Read more…
How AWS Plans to Cope with GenAI’s Insatiable Desire for Compute
Companies that toyed around with generative AI this year will be looking to play for keeps in 2024 with production GenAI apps that move the business needle. Considering there’s not enough GPUs to go around now, where w Read more…
Five AWS Predictions as re:Invent 2023 Kicks Off
The computing world this week turns to Amazon Web Services, the company that originally defined the public cloud space and continues to enjoy the largest slice of the cloud pie. Its annual re:Invent conference, which kic Read more…
Pandas on GPU Runs 150x Faster, Nvidia Says
Data scientists and others who work in pandas may be interested to hear about a new release of Nvidia’s RAPIDS cuDF framework that it says results in a 150x performance boost for pandas running atop a GPU. Pandas is Read more…
Anyscale and Nvidia In LLM Hookup
GenAI developers building atop large language models (LLMs) are the big winners of a new partnership between Anyscale and Nvidia unveiled this week that will see the GPU maker’s AI software integrated into Anyscale’s Read more…
ChatGPT Puts AI At Inflection Point, Nvidia CEO Huang Says
It’s been 11 years since three AI researchers shocked the world with a breakthrough in computer vision, kickstarting the deep learning craze. But with emergence of generative language models like ChatGPT over the past Read more…
Nvidia Unveils GPUs for Generative Inference Workloads like ChatGPT
Today at its GPU Technology Conference, Nvidia took the wraps off three new GPUs designed to accelerate inference workloads for generative AI applications, including generating text, images, and videos. It also launched Read more…