このページは http://www.slideshare.net/ydn/nlessons-from-hadoop-2java8-migration-at-linkedin の内容を掲載しています。
Hadoop has been a critical part of LinkedIn’s massive data infrastructure by providing reliable d...
Hadoop has been a critical part of LinkedIn’s massive data infrastructure by providing reliable data storage and efficient processing frameworks. To accommodate increasing amounts of data and processing overhead, LinkedIn has been an early adopter of the Hadoop ecosystem. Since last year, the Hadoop team at LinkedIn has evaluated the Hadoop 2/YARN framework and currently is migrating existing clusters to YARN. LinkedIn is also leading the effort to run Hadoop on the latest JDK 8. Additionally, new versions of Pig, Hive, & Azkaban have been deployed which are Hadoop 2 compliant. During LinkedIn’s migration, the Hadoop team closely worked with the open source community by reporting issues using Apache Jira and submitting patches to upstream projects. In this presentation, I will cover the challenges and discoveries made while migrating thousands of jobs from Hadoop 1 to Hadoop 2 at LinkedIn.
Mohammad Kamrul Islam, VP, Apache Oozie at ASF, Staff Software Engineer at LinkedIn, Committer of Apache Tez
Adam Faris, Apache Hadoop and Hive contributor, Staff Engineer at LinkedIn