Clik here to view.
HDFS Transparent Data Encryption
Many HDP users are increasing their focus on security within Hadoop and are looking for ways to encrypt their data. Fortunately, Hadoop provides several options for encrypting data at rest. At the...
View ArticleUsing Apache Spark: Technical Preview with HDP 2.2
Introduction The Spark Technical preview lets you evaluate Apache Spark 1.2.0 on YARN with HDP 2.2. With YARN, Hadoop can now support various types of workloads; Spark on YARN becomes yet another...
View ArticleHOWTO: Test MapReduce Setup
ISSUE How do I run an example map reduce job? Or How do I test the map reduce services are working? SOLUTION Make sure the job tracker and the task trackers are started. To start the job tracker: su...
View ArticleHOWTO: Test HDFS Setup
ISSUE How do I run simple Hadoop Distributed File System tasks? Or How do I test that HDFS services are working? SOLUTION Make sure the name node and the data nodes are started. To start the name node:...
View ArticleSpark 1.1.0 Technical Preview on HDP 2.1.5
Spark 1.1.0 Technical Preview – with HDP 2.1.5 Introduction The Spark Technical preview lets you evaluate Apache Spark 1.1.0 on YARN with HDP 2.1.5. With YARN, Hadoop can now support various types of...
View ArticleSpark 1.0.1 Technical Preview – with HDP 2.1.3
Introduction The Spark Technical preview lets you evaluate Apache Spark 1.0.1 on YARN with HDP 2.1.3. With YARN, Hadoop can now support multiple different types of workloads; Spark on YARN becomes...
View ArticleClik here to view.
Storm on YARN Install on HDP2 Beta Cluster
This is the installation instructions for Storm on YARN. Our work is based on the code and documentation provided by Yahoo in the Storm-YARN repository at https://github.com/yahoo/storm-yarn We...
View ArticleHOWTO: Test HDFS Setup
ISSUE How do I run simple Hadoop Distributed File System tasks? Or How do I test that HDFS services are working? SOLUTION Make sure the name node and the data nodes are started. To start the name node:...
View ArticleHOWTO: Make the Sandbox run faster
If you are having performance issues with the Sandbox, try the following: Run only 1 virtual machine at a time Reboot the virtual machine Allocate more RAM to the Sandbox VM. This assumes you have more...
View ArticleHOW TO: Connect/Write a File to Hortonworks Sandbox from Talend Studio
Writing a file to Hortonworks Sandbox from Talend Studio I recently needed to quickly build some test data for my Hadoop environment and was looking for a tool to help me out. What I discovered was...
View ArticleClik here to view.
HOW TO: Connect Tableau to Hortonworks Sandbox
Tableau, Apache Hive and the Hortonworks Sandbox As with most BI tools Tableau can use Apache Hive (via ODBC connection) as the defacto standard for SQL access in Hadoop. Establishing a connection from...
View ArticleHOWTO Test Hbase Setup
ISSUE How do I test that Hbase is working properly? OR What is a simple set of Hbase Commands? SOLUTION If HBase processes are not running, start them with the following commands: To start the HBase...
View ArticleHOWTO: Optimal Way to Shut Down an HDP Slave Node
ISSUE What is the optimal way to shut down a HDP slave node SOLUTION HDP slave nodes are usually configured to run the datanode and tasktracker processes. If HBase is installed, then the slave nodes...
View ArticleHow To: Install and Configure the Hortonworks ODBC driver on Windows 7
This document describes how to install and configure the Hortonworks ODBC driver on Windows 7. After you install and configure the ODBC driver, you will be able to access Hortonworks sandbox data using...
View ArticleHow To: Install and Configure the Hortonworks ODBC driver on Mac OSX
This document describes how to install and configure the Hortonworks ODBC driver on Mac OS X. After you install and configure the ODBC driver, you will be able to access Hortonworks sandbox data using...
View ArticleClik here to view.
Get Started: Ambari for provisioning, managing and monitoring Hadoop
Ambari is 100% open source and included in HDP, greatly simplifying installation and initial configuration of Hadoop clusters. In this article we’ll be running through some installation steps to get...
View ArticleClik here to view.
HOWTO: Ambari on EC2
This document is an informal guide to setting up a test cluster on Amazon AWS, specifically the EC2 service. This is not a best practice guide nor is it suitable for a full PoC or production install of...
View ArticleHOWTO: Install the Latest MySQL on a Linux Target
ISSUE: hcat requires some sort of persistent db to store schema information SOLUTION 1: Specific host access only grab the latest package > yum -y install mysql-server configure autostart at boot...
View ArticleClik here to view.
Hadoop MapReduce Defined
Hadoop MapReduce is the way Hadoop processes data. MapReduce uses the Hadoop Distributed File System to handle the distribution of data on the cluster. MapReduce is how Hadoop parallelizes its...
View ArticleClik here to view.
Hadoop Distributed File System (HDFS) Defined
The best place for a deep dive into HDFS is the HDFS Architecture page. Here we’ll take an abbreviated view of what HDFS is, and why it matters. The Hadoop Distributed File System is the backbone of a...
View Article
