Hadoop Setup.

A beautiful &
automated installer for
Apache Hadoop on macOS.

Quick Install

One-line installation

Copy and paste this command in your terminal to get started instantly. The script will automatically detect your Java installation and configure everything for you.

curl -fsSL https://mohitp.me/api/scripts/hadoop-setup | bash

Non-interactive Installation

For automated deployments, use the auto-install mode:

HADOOP_AUTO_INSTALL=true curl -fsSL https://mohitp.me/api/scripts/hadoop-setup | bash

What it does

Sit Back & Relax

Complete hands-off installation with beautiful progress indicators and detailed logging.

Smart Detection

Intelligently detects Java 11 installations from system paths, Homebrew, or JavaVirtualMachines directory.

Safe & Reliable

Uses Homebrew for package management and includes proper error handling and cleanup.

Ready to Use

Starts all Hadoop services and provides web UI access at localhost:9870.

Enhanced Java Detection

Intelligent Java 11 Detection

The script now intelligently detects Java 11 installations from multiple sources and provides helpful guidance if not found.

System Installation

Checks /usr/libexec/java_home for system-wide Java installations

Homebrew

Detects openjdk@11 installed via Homebrew package manager

JavaVirtualMachines

Scans /Library/Java/JavaVirtualMachines/ for manual installations

No Java 11 found?

The script provides direct download links and installation commands to help you get started quickly.

Requirements

Before you start

macOS system (tested on macOS 11+)

Homebrew installed (brew.sh)

Java 11 (script will help locate or suggest installation)

Administrator privileges for system modifications

Manual Installation

Step-by-step guide

Prefer to do it manually? Here's what the script does behind the scenes.

Checks for Homebrew installation

Detects Java 11 from multiple sources (system, Homebrew, JavaVirtualMachines)

Installs Apache Hadoop via Homebrew

Configures Hadoop environment variables

Sets up SSH for passwordless access

Formats the Hadoop NameNode (first-time only)

Starts all Hadoop services (HDFS, YARN, MapReduce)

Access points after installation:

Hadoop Web UI:

http://localhost:9870

YARN Resource Manager:

http://localhost:8088

Useful commands:

jps - Check running Hadoop processes

start-all.sh - Start all Hadoop services

stop-all.sh - Stop all Hadoop services

Created by Mohit Paddhariya

FullStack & Gen-AI Developer • mohitp.me