How to Install Apache Spark on Linux Ubuntu

First of all, you need to have Java already installed; if you don't I recommend this article to install Java. Then you will need to install Scala:

	wget https://downloads.lightbend.com/scala/2.12.11/scala-2.12.11.tgz
	tar xvf scala-2.12.11.tgz
	sudo mv scala-2.12.11 /usr/local/scala

view raw sh hosted with ❤ by GitHub

Once done installing Scala, you will need to download the Apache Spark binaries archive and install it:

	wget https://archive.apache.org/dist/spark/spark-3.0.0/spark-3.0.0-bin-hadoop3.2.tgz
	tar xvf spark-3.0.0-bin-hadoop3.2.tgz
	sudo mv spark-3.0.0-bin-hadoop3.2 /usr/local/spark
	sudo cp /usr/local/spark/conf/log4j.properties.template /usr/local/spark/conf/log4j.properties

view raw sh hosted with ❤ by GitHub

Afterward and in order to avoid moving to Spark's bin directory every time you want to interact with it, add Spark's bin directory to the PATH system's variable. To do so open .bashrc script vim .bashrc and add the following lines in the bottom of the file:

	export SCALA_HOME=/usr/local/scala
	export PATH=$SCALA_HOME/bin:$PATH
	export SPARK_HOME=/usr/local/spark
	export PATH=$SPARK_HOME/bin:$PATH

view raw .bashrc hosted with ❤ by GitHub

That's it, you only have to apply the last modifications running source ~/.bashrc

How to Install MongoDB on Linux Ubuntu 18.04

1- Import the MongoDB public GPG Key:

wget -qO - https://www.mongodb.org/static/pgp/server-4.2.asc | sudo apt-key add -

view raw sh hosted with ❤ by GitHub

2- Create the /etc/apt/sources.list.d/mongodb-org-4.2.list file for Ubuntu 18.04 (Bionic):

echo "deb [ arch=amd64,arm64 ] https://repo.mongodb.org/apt/ubuntu bionic/mongodb-org/4.2 multiverse" | sudo tee /etc/apt/sources.list.d/mongodb-org-4.2.list

view raw sh hosted with ❤ by GitHub

3- Reload the local package database:

sudo apt-get update

view raw sh hosted with ❤ by GitHub

4- Install MongoDB:

sudo apt-get install -y mongodb-org=4.2.8 mongodb-org-server=4.2.8 mongodb-org-shell=4.2.8 mongodb-org-mongos=4.2.8 mongodb-org-tools=4.2.8

view raw sh hosted with ❤ by GitHub

5- Start MongoDB service:

sudo systemctl start mongod

view raw sh hosted with ❤ by GitHub

6- Start a Mongo shell:

mongo

view raw sh hosted with ❤ by GitHub

8- Create users database:

use admin

view raw sh hosted with ❤ by GitHub

9- Create an adminstrator user:

	db.createUser({
	user: 'admin',
	pwd: 'password',
	roles: [{ role: 'root', db:'admin'}]
	})

view raw sh hosted with ❤ by GitHub

10- Exit the Mongo shell:

exit

view raw sh hosted with ❤ by GitHub

11- Open the MongoDB configuration file sudo vim /etc/mongod.conf and edit the following parameters:

	# network interfaces
	net:
	port: 27017
	bindIp: 0.0.0.0
	security:
	authorization: enabled

view raw conf hosted with ❤ by GitHub

12- Restart MongoDB process:

sudo systemctl restart mongod

view raw sh hosted with ❤ by GitHub

How to Install Apache Kafka on Linux Ubuntu

In order to install Apache Kafka you should have Java installed and JAVA_HOME environment variable set; if not follow the first instructions of this article.
1- Download Zookeeper:

wget http://apache.mirror.anlx.net/zookeeper/zookeeper-3.6.1/apache-zookeeper-3.6.1-bin.tar.gz

view raw sh hosted with ❤ by GitHub

2- Extract the archive content:

tar -xvzf apache-zookeeper-3.6.1-bin.tar.gz

view raw sh hosted with ❤ by GitHub

3- Create Zookeeper configuration file from the sample provided:

cp apache-zookeeper-3.6.1-bin/conf/zoo_sample.cfg apache-zookeeper-3.6.1-bin/conf/zoo.cfg

view raw sh hosted with ❤ by GitHub

4- Open the startup script file vim ~/.bashrc and add the following content:

	export ZOOKEEPER_HOME=/home/ubuntu/apache-zookeeper-3.6.1-bin
	export PATH="$PATH:${ZOOKEEPER_HOME}/bin"

view raw .bashrc hosted with ❤ by GitHub

5- activate the new path settings:

source ~/.bashrc

view raw sh hosted with ❤ by GitHub

6- Start zookeeper service:

zkServer.sh start

view raw sh hosted with ❤ by GitHub

7- Download Kafka:

wget http://apache.mirror.anlx.net/kafka/2.5.0/kafka_2.12-2.5.0.tgz

view raw sh hosted with ❤ by GitHub

8- Create an installation folder for Kafka:

sudo mkdir /opt/kafka

view raw sh hosted with ❤ by GitHub

9- Extract the archive content:

sudo tar -xvzf kafka_2.12-2.5.0.tgz -C /opt/kafka

view raw sh hosted with ❤ by GitHub

10- Open the startup script file vim ~/.bashrc and add the following content:

	export KAFKA_HOME=/opt/kafka/kafka_2.12-2.5.0
	export PATH="$PATH:${KAFKA_HOME}/bin"

view raw .bashrc hosted with ❤ by GitHub

11- activate the new path settings:

source ~/.bashrc

view raw sh hosted with ❤ by GitHub

12- Create a shortcut to Kafka configuration file:

sudo ln -s /opt/kafka/kafka_2.12-2.5.0/config/server.properties /etc/kafka.properties

view raw sh hosted with ❤ by GitHub

13- Edit listners parameter within Kafka configuration file i.e.:
listeners=PLAINTEXT://thedevopsnerdworld.com:9092
14- Start Kafka service:

kafka-server-start.sh /etc/kafka.properties

view raw sh hosted with ❤ by GitHub

The Best Way to Install Java JDK and Eclipse IDE on Linux Ubuntu Desktop

In order to install Java on your ubuntu, I assume you are working from home directory cd ~ or cd $HOME which in my case is "/home/omar" or use sudo su - to switch to root user and avoid typing sudo everytime you need root privilege. To start, open a new terminal Ctrl+Alt+T and run the following command:

sudo apt update && sudo apt install openjdk-11-jdk-headless -y

view raw sh hosted with ❤ by GitHub

then run the command below to find JDK installation directory:

update-alternatives --config java

view raw sh hosted with ❤ by GitHub

Afterward, open the startup script file vim ~/.bashrc and add the following lines in the bottom:

	export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64
	export PATH=$JAVA_HOME/bin:$PATH

view raw .bashrc hosted with ❤ by GitHub

then run the following command to activate the new path settings immediately:

source ~/.bashrc

view raw sh hosted with ❤ by GitHub

Now that you have java installed, go to Eclipse IDE download page: https://www.eclipse.org/downloads/download.php?file=/oomph/epp/2020-06/R/eclipse-inst-linux64.tar.gz and download the Eclipse installer archive. Once downloaded, extract the archive content by running the command below:

sudo tar -xvzf eclipse-inst-linux64.tar.gz

view raw sh hosted with ❤ by GitHub

After extracting the installer, open vim ~/eclipse-installer/eclipse-inst.ini file and append the following configuration:

	-vm
	/usr/lib/jvm/java-11-openjdk-amd64/bin/java

view raw ini hosted with ❤ by GitHub

then launch the installer: cd ~/eclipse-installer/ && ./eclipse-inst and choose Eclipse IDE for Enterprise Java Developers. Once you have Eclipse installed, open its configuration file vim ~/eclipse/jee-2020-06/eclipse/eclipse.ini and add the following:

	-vm
	/usr/lib/jvm/java-11-openjdk-amd64/bin/java

view raw ini hosted with ❤ by GitHub

now, create a shortcut for eclipse by creating a new file vim ~/eclipse.desktop and inserting the following content into it:

	[Desktop Entry]
	Name=Eclipse
	Type=Application
	Exec=/home/omar/eclipse/jee-2020-06/eclipse/eclipse
	Terminal=false
	Icon=/home/omar/eclipse/jee-2020-06/eclipse/icon.xpm
	Comment=Integrated Development Environment
	NoDisplay=false
	Categories=Development;IDE;
	Name[en]=Eclipse
	Name[en_US]=Eclipse

view raw eclipse.desktop hosted with ❤ by GitHub

then install the shortcut:

sudo desktop-file-install eclipse.desktop

view raw sh hosted with ❤ by GitHub

That's it, congratulation! from now on you can find your Eclipse among Ubuntu applications.

Bonus: 

 You can also install Lombok utility within eclipse; all you have to do is go to Lombok download page: https://projectlombok.org/download and download the jar. Once the jar downloaded, launch it by running java -jar lombok.jar and specify the eclipse.ini file location /home/omar/eclipse/jee-2020-06/eclipse/eclipse.ini