Follow BigDATAwire:

Vendor » LinkedIn

Features

LinkedIn Implements New Data Trigger Solution to Reduce Resource Usage For Data Lakes

With its vast user base and the numerous interactions that occur daily, LinkedIn generates an enormous amount of data every day. The billions of data points fuel various applications, from rankings to search. The additio Read more…

Navigating the AI Skills Revolution in the Age of GenAI: LinkedIn Report

The launch of ChatGPT and similar generative AI technologies is reshaping the skills required in the workplace, according to a new report from LinkedIn. “The Future of Work Report: AI at Work” found the pace at wh Read more…

Acryl Data Raises $21M in Bid to Unify Data Stack

Acryl Data, the company driving the open source data catalog called the DataHub Project, got a boost in its quest to unify the fragmented data stack today when it announced the completion of a $21 million Series A round. Read more…

Apache Beam Cuts Processing Time 94% for LinkedIn

Like many large companies, LinkedIn relied on the Lamba architecture to run separate batch and streaming workloads, with a form of reconciliation at the end. After implementing Apache Beam, it was able to combine batch a Read more…

LinkedIn Donates Feature Store to Linux Foundation

LinkedIn today announced that its open source feature store, dubbed Feathr, is joining LF AI & Data, the Linux Foundation’s umbrella foundation for big data and AI projects. Feathr was originally developed at Li Read more…

LinkedIn Open Sources Tech Behind 10,000-Node Hadoop Cluster

LinkedIn last week open sourced DynoYARN, a key piece of technology that allows it to predict how appliacation performance will be impacted as it scales Hadoop to gargantuan proportions, including one 10,000-node cluster Read more…

LinkedIn’s Translation Engine Linked to Presto

An SQL translation engine unveiled this week by LinkedIn is integrated with other open-source SQL query engines like Presto in a combination aimed at bulging data lakes. The Microsoft unit’s Coral engine handles ana Read more…

LinkedIn Open Sources Dagli to Simplify ML Pipeline Building

LinkedIn yesterday announced that it has open sourced Dagli, a Java-based framework for building and deploying machine learning pipelines. While the number and quality of tools for developing machine learning models h Read more…

The Future of Labor in an AI World

What will you be doing on Labor Day in 2030? How about five years from today? Will your job still be available? What skills will your employer demand? Nobody can forecast the future with total certainty, but a conservati Read more…

LinkedIn Unveils Open-Source Toolkit for Detecting AI Bias

As AI becomes increasingly integrated in our day-to-day lives, the implications of bias in AI grow more and more worrisome. Training data that appears impartial is often influenced by historical and socioeconomic factors Read more…

This Just In

Liger-Kernel: Empowering an Open Source Ecosystem of Triton Kernels for Efficient LLM Training

Dec 6, 2024 |

Dec. 5, 2024 — In a LinkedIn engineering blog published this week, Byron Hsu and Yun Dai shared a closer look at Liger-Kernel, LinkedIn’s open source library designed to maximize GPU efficiency for LLM training by addressing inefficiencies in GPU memory management and I/O throughput. Read more…

LakeChime: A Data Trigger Service for Modern Data Lakes

May 2, 2024 |

May 2, 2024 — LinkedIn has announced the launch LakeChime, a new data trigger service designed to streamline data management within modern data lakes. Read more…

BigDATAwire