Skip to main content

Controlling Hadoop Jobs using Oozie Big Data University

Enrollment in this course is by invitation only

About This Course

This course gives an overview of Oozie and how it is able to control Hadoop jobs. It begins with looking at the components required to code a workflow as well as optional components such as case statements, forks, and joins. That is followed by using the Oozie coordinator in order to schedule a workflow.

One of the things that the student will quickly notice is that workflows are coded using XML which tends to get verbose. The last lesson of this course shows a graphical workflow editor tool designed to simplify the work in generating a workflow.

This course was recently tested and updated for BigInsights Quick Start 3.0.

This course was tested and validated for v3 of the QSE VM.

Please download the v3 VM to complete the lab exercises.

https://www14.software.ibm.com/webapp/iwm/web/preLogin.do?source=swg-beta-iibob

Course Syllabus

After completing this course, you should be able to:

  • Describe the MapReduce model v1
  • List the limitations of Hadoop 1 and MapReduce 1
  • Review the Java code required to handle the Mapper class, the Reducer class, and the program driver needed to access MapReduce
  • Describe the YARN model
  • Compare YARN / Hadoop 2 / MR2 vs Hadoop 1 / MR1
  • If you did not pass the course, you can take it again at any time.
  • Requirements

    Have taken the Hadoop Fundamentals course on Big Data University.

    Course Staff

    Course Staff Image #1

    Glen R.J. Mules

    Glen R.J. Mules is a Senior Instructor and Principal Consultant with IBM Information Management World-Wide Education and works from New Rochelle, NY. Glen joined IBM in 2001 as a result of IBM's acquisition of Informix Software. He has worked at IBM, and previously at Informix Software, as an instructor, a course developer, and in the enablement of instructors worldwide. He teaches courses in BigData (BigInsights & Streams), Optim, Guardium, and DB2, & Informix databases. He has a BSc in Mathematics from the University of Adelaide, South Australia; an MSc in Computer Science from the University of Birmingham, England; and has just completed a PhD in Education (Educational Technology) at Walden University. His early work life was as a high school teacher in Australia. In the 1970s he designed, programmed, and managed banking systems in Manhattan and Boston. In the 1980s he was a VP in Electronic Payments for Bank of America in San Francisco and New York. In the early 1990s he was an EVP in Marketing for a software development company and chaired the ANSI X12C Standards Committee on Data Security for Electronic Data Interchange (EDI).

    Course Staff Image #2

    Warren Pettit

    Warren Pettit has been with IBM for over 30 years. For the last 16 years, he has worked in Information Management education where he has been both an instructor and a course developer in the Data Warehouse and Big Data curriculums. For the nine years prior to his joining IBM, he was an application programmer and was responsible for developing a training program for newly hired programmers.

    Grading Scheme

    The minimum passing mark for the course is 60%, where the final test is worth 100% of the course mark. You have 3 attempts to take the test.

    Frequently Asked Questions

    What web browser should I use?

    The Open edX platform works best with current versions of Chrome, Firefox or Safari, or with Internet Explorer version 9 and above.

    See our list of supported browsers for the most up-to-date information.

    1. Course Number

      BD0133EN
    2. Classes Start

      Any Time, Self-Paced
    3. Estimated Effort

      04:00