NiFi (Niagrafiles) was created by the NSA as a big-data automation system. The NSA released NiFi as open-source software in 2014 and became an incubator development as Apache NiFi. Apache Nifi graduated from incubator status and became a Top-Level-Project with the Apache Software Foundation on July 20, 2015.
Apache NiFi enables visual programming for the creation of scalable directed graphs for data routing, transformation, system mediation logic and data provenance.
This course introduces the student to the high-level capabilities of Apache NiFi and a subproject of NiFi, MiNiFi.
50% Lecture 50% Hands-on Labs
This course is intended for data infrastructure architects, data engineers, data analysts and individuals involved with data governance and data provenance who need to automate the requirements and capabilities of their existing or greenfield data flow topologies and data infrastructures.
Development experience with Linux, Java and Hadoop are a prerequisite. Knowledge or experience with implementing EAI/EII patterns is assumed. It is suggested that a student new to Hadoop first take the course ’Advanced Hadoop.’ A student not familiar with EAI/EII patterns might wish to visit http://www.enterpriseintegrationpatterns.com/
- Day 1: Introduction to NiFi
- Day 2: Introduction to MiNiFi
- Day 3: NiFi and Data Provenance Practices
- Day 4: Integration of NiFi with Security frameworks and practices
- Day 5: Extending NiFi