Having worked on Hadoop since day one in 2006, Hortonworks co-founder Arun Murthy is clear about the significance of the latest version of the open-source big-data technology. "Hadoop 2 is a big step.

Hadoop has been known as MapReduce running on HDFS, but with YARN, Hadoop 2.0 broadens pool of potential applications Hadoop has always been a catch-all for disparate open source initiatives that ...

Hadoop is about to see a fundamental reset in its base functionality, says Arun Murthy, architect with Hortonworks and the Apache Software Foundation, who says that SQL in Hadoop via YARN is a part of ...

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

The Hadoop community recently promoted YARN-- the next-gen Hadoop data processing framework -- to the status of "sub-project" of the Apache Hadoop Top Level Project. The promotion puts YARN on the ...

Scheduling means different things depending on the audience. To many in the business world, scheduling is synonymous with workflow management. Workflow management is the coordinated execution of a ...

Hortonworks announced that the Apache Spark, a new high-performance analytics engine, is fully enabled for the YARN resource management technology. This means that the Apache Spark can be deployed ...

YARN – the fledgling next-gen MapReduce subproject to the incredibly popular Apache Hadoop big data platform – may already have some competition as Dremel, an analytics platform borne in Google’s labs ...

New reports have emerged of expanding security threats targeting cloud-based Hadoop and YARN instances, including more sophisticated attacks described as “multi ...