Hive Query Tunings Video
In this video, learn how to configure YARN queues, Tez and Hive properties to support performance goals. Sunset Learning instructor, RJ Daskevich, will teach you how to tune Hive for interactive queries and configure containers. For optimum performance with interactive Hive queries, you must:
- Modify Hive, Tez, and YARN settings based on application characteristics
- Modify queues and queue settings based on application characteristics
- Batch vs. Interactive Processing (2:46)
- How we can make Hive go from Batch to Interactive processing.
- Why Tune for Hive Performance? (3:58)
- Tuning for Interactive Queries (4:19)
- Increase HDFS Replication Factor (6:21)
- Create Multiple HiveServer2 Instances (6:46)
- Example of a Highserver2 ETL vs. BI
- Queue Strategies (7:50)
- Configure Tez Idle Container Settings (9:25)
- Example of what the container settings mean
- Configure Tez Held Containers (10:52)
- Increase Tez DAG Submission Timeout (11:52)
- Additional Considerations (12:25)
- Monitor, Monitor, Monitor!
See our list of Hortonworks/Big Data classes! All our classes are guaranteed to run.
Refer to Hive Performance Tuning Guide at http://docs.hortonworks.com for additional information.
Ronald Daskevich has been involved in information systems for over 25 years. His IT career started while he was an Officer in the U.S. Air Force. Academically, RJ has continually shown his life-long of learning. He recently graduated from Colorado Technical University as a Doctor of Applied Science in Computer Science with a specialty in big data in December 2016. RJ is currently employed by Sunset Learning as a technical instructor specializing in the delivery of the entire Hortonworks Apache Hadoop curriculum. He not only teaches Hadoop admin classes, but has also become an expert in open source development frameworks such as Apache Hive, Apache Pig, and Spark. He also teaches Hortonworks’ only data science offering.
Big Data, Hortonworks, Webinar