Carlos Aguni

Highly motivated self-taught IT analyst. Always learning and ready to explore new skills. An eternal apprentice.


Cloudera Private Cloud Install

06 Jul 2022 »

Cloudera CDP Private

https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/yarn-managing-docker-containers/topics/yarn-install-docker.html

Download

https://www.cloudera.com/downloads/cdp-private-cloud-trial/cdp-private-cloud-base-trial.html

mv /etc/redhat-release /etc/redhat-release.bk
echo "CentOS Linux release 8.4 (Core)" > /etc/redhat-release
curl -O https://archive.cloudera.com/cm7/7.4.4/cloudera-manager-installer.bin
chmod u+x cloudera-manager-installer.bin
sudo ./cloudera-manager-installer.bin

Setup SSH Private key

https://medium.com/@divyagayatri8/ssh-private-key-error-in-bamboo-d34400b744ce

ssh-keygen -p -N "" -m pem

Ulimits

ulimit -s unlimited
ulimit -n 30000

/etc/security/limits.conf

* soft stack unlimited
* hard stack unlimited
* soft nofile 30000
* hard nofile 30000

Caveats

https://community.cloudera.com/t5/Support-Questions/hive-server-restarted-failed-with-error-stopping-schq/td-p/312210

2021-02-25 14:20:06,800 ERROR org.apache.hive.service.server.HiveServer2: [shutdown-hook-0]: Error stopping schq
java.lang.IllegalStateException: The current ScheduledQueryExecutionService INSTANCE is invalid
at

add to /opt/cloudera/cm-agent/service/hive/hive.sh TEZ_JARS="/opt/cloudera/parcels/CDH/jars/tez-*:/opt/cloudera/parcels/CDH/lib/tez/*.jar:$CONF_DIR/tez-conf"

increase YARN containzer size

Provision

ec2 aws console

add traditional bare metal

cluster configuration

panel dashboard

per role

dashboard

Server01

Server02

Server03