Tag: facebook
Why Twitter Is the Low-Hanging Fruit of Social Analytics
Nobody is mistaking the Twitter fire hose for a crystal ball. But big companies are increasingly turning to Twitter and other social media outlets for a range analytic tasks, from gauging customer sentiment about bendy s Read more…
Faceboook Gets Smarter with Graph Engine Optimization
Last fall, the folks in Facebook's engineering team talked about how they employed the Apache Giraph engine to build a graph on its Hadoop platform that can host more than a trillion edges. While the Graph Search engine is capable of massive graphing tasks, there were some workloads that remained outside the company's technical capabilities--until now. Read more…
Rudin: Big Data is More Than Hadoop
In a presentation at the Strata + Hadoop World conference this week, Facebook Analytics boss, Ken Rudin, admonished the audience to question some of the commonly held beliefs about big data that he believes need to be challenged. Read more…
Facebook’s Open Compute Cold Storage on Display
Facebook’s Open Compute Architecture was on display this week when it opened up its newest cold storage facility for a press peek. Read more…
Facebook’s Ambitious Global Big Data Program
What’s cooler than millions of Facebook users? Billions of Facebook users. Or so supposes a report released this week by Facebook’s Internet.org group. Officially launched late last month, Internet.org is a group that combines the powers of Facebook, Ericsson, MediaTek, Nokia, Opera, Qualcomm, and Samsung toward the ideal of making Internet access available “to the next five billion people.” Read more…
Data Science Has Got Talent as Facebook Launches Competition
So you think you've got the talent to be a Facebook data scientist? Hold the resume – you won’t need it. Facebook is now moving their data science human resource search to Kaggle, the online data science competition portal. Read more…
Facebook Advances Giraph With Major Code Injection
Apache Giraph received a Facebook-sized shot in the arm, as the social network announced that they've injected performance enhancing code into the trunk of the open source graph analytics project, scaling the capabilities of the framework past a trillion edges. Read more…
Data Center Building Boom Comes to Iowa
If you're a tech giant and you're looking for a place to build a new data center, there's a good chance that a location in Iowa will be on your short list. Several billion-dollar data center projects are in the works in Iowa, which offers relative security from natural disasters, tax incentives, and a thriving clean energy industry. Read more…
Facebook Drills In Big Data Thinking at Bootcamps
With more than a billion members on its social networking website, Facebook generates its share of big data, which it uses to continually test and improve its service. While the company employs a select group of super-skilled data analyst ninjas, it's also hoping to foster a certain level of comfort with data among all employees through a series of big data bootcamps. Read more…
Facebook Molds HDFS to Achieve Storage Savings
The Hadoop file system, HDFS, has been under a lot of fire over the last year as various corners of the industry have maligned the file system for some of its perceived limitations. Big data pioneer and social giant, Facebook, has seen fit to tackle their big data growth with HDFS and say they're reaping the financial rewards in the form of storage savings. Read more…
Putting Some Real Time Sting into Hive
A coalition of Hive community enthusiasts report that they have achieved a 45x performance increase for Apache Hive through an effort they have branded “The Stinger Initiative.” The group says they are aiming at 100x improvement. Read more…
How Facebook Fed Big Data Continuuity
We recently sat down with Jonathan Gray, who helped build some of the complex HBase infrastructure at Facebook that powered real-time services, including its Messages service, about what was needed to make Hadoop and HBase robust, flexible and consumable for Facebook--and now, through his startup Continuuity, for smaller companies that have big data.... Read more…
Facebook Pushes Open Hardware Drive
Facebook's push into open hardware is going so well that they're preparing to open a 290,00-square-foot data center in Sweden stocked entirely with open sourced servers. Read more…
What Sociologists Say About Big Data
Social science has already found results regarding the internet and the people who use it which would be useful to big data research. The major finding they cite is that British researchers from Reuters and the Oxford Internet Institute have found that social media has established itself as the “Fifth Estate”... Read more…
Facebook Sees Hadoop Through Prism
Splitting a Hadoop cluster is difficult, explains Facebook’s VP of Engineering Jay Parikh. “The system is very tightly coupled,” said Facebook’s VP of Engineering Jay Parikh as he was explaining why this splitting of Hadoop clusters was not possible... Read more…
Six Super-Scale Hadoop Deployments
This has been a stellar year for the big data ecosystem, in part due to the vitality of the ecosystem that has been developing around Apache's open source big data framework, Hadoop. While it's necessary to keep enthusiasm in check since it's by no means a fit for all users, we've highlighted six large-scale Hadoop use cases that highlight the ability of.... Read more…