Carlos Aguni

Highly motivated self-taught IT analyst. Always learning and ready to explore new skills. An eternal apprentice.


Writing YARN applications

03 Apr 2022 »

https://pt.slideshare.net/PhilippeJulio/hadoop-architecture/25-MR_VS_YARN_ARCHITECTURE_MR

Kitten

The fast and fun way to write YARN applications.

https://github.com/cloudera/kitten

Hadoop in Practice, 2nd Edition - Chapter 10. Writing a YARN application

https://livebook.manning.com/book/hadoop-in-practice-second-edition/chapter-10/1

running a custom shell script distributed shell apache yarn

  • https://stackoverflow.com/questions/30840143/running-a-custom-shell-script-distributed-shell-apache-yarn
    • https://github.com/dask/knit
      • https://github.com/dask/dask-yarn
      • https://github.com/jcrist/skein

MPICH2-yarn

https://github.com/alibaba/mpich2-yarn

MPI-YARN

https://github.com/stevenybw/mpi-yarn

Hadoop: Writing YARN Applications

https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html

hadoop-yarn-api-python-client

https://github.com/CODAIT/hadoop-yarn-api-python-client

https://yarn-api-client-python.readthedocs.io/en/latest/