MATLAB Answers

0

Can develop MapReduce program by MATLAB run effectively with Hadoop?

Asked by Mohammad Al Nagdawi on 10 Feb 2018
Latest activity Answered by Kojiro Saito on 11 Feb 2018
Hadoop by default support Java, C++, and python. However, I developed an algorithm using Matlab to deal with normal size data, later I decide to scale my algorithm using MapReduce to deal with big data.
I want to continue my work in Matlab, but I don't know if Matlab fully and smoothly supports Hadoop or not, therefore I want to hear advice from experts before it's too late.

  0 Comments

Sign in to comment.

1 Answer

回答者: Kojiro Saito
2018 年 2 月 11 日

MATLAB does support MapReduce on Hadoop with MATLAB Compiler OR Parallel Computing Toolbox / MATLAB Distributed Computing Server.
(1) MATLAB Compiler
With MATLAB Compiler, you can create compiled MapReduce applications. This is a compiled application, so you can execute it with MATLAB Runtime.
(2) Parallel Computing Toolbox / MATLAB Distributed Computing Server With these parallel products, you can scale up your mapreduce algorithm to Hadoop.
Before executing mapreduce, it's needed to configure mapreducer environment, for example,
setenv('HADOOP_HOME', '/path/to/hadoop_home/');
cluster = parallel.cluster.Hadoop;
mr = mapreducer(cluster);
For detail, please see this doc: Run mapreduce on a Hadoop Cluster

  0 Comments

Sign in to comment.