broadcast

Class: matlab.compiler.mlspark.SparkContext
Namespace: matlab.compiler.mlspark

Broadcast a read-only variable to the cluster

Syntax

result = broadcast(sc,value)


Description

result = broadcast(sc,value) broadcasts a read-only variable value to the cluster initialized by SparkContext sc.

Input Arguments

sc — SparkContext to use

SparkContext object

The SparkContext to use, specified as a SparkContext object.

value — Value to be broadcast

any supported data type

The value to be broadcast, specified as any supported data type.

Data Types: single | double | int8 | int16 | int32 | int64 | uint8 | uint16 | uint32 | uint64 | logical | char | struct | table | cell | function_handle | categorical | string

Output Arguments

result — Broadcast variable

Broadcast object

Broadcast variable, returned as a broadcast object with the following properties:

• id

• value

• path

Examples

Broadcast a Variable

Broadcast a read-only variable to the cluster.

%% Connect to Spark
sparkProp = containers.Map({'spark.executor.cores'}, {'1'});
conf = matlab.compiler.mlspark.SparkConf('AppName','myApp', ...
                        'Master','local[1]','SparkProperties',sparkProp);
sc = matlab.compiler.mlspark.SparkContext(conf);

%% broadcast
myRdd = sc.parallelize({1,2,3,4,5});
myBroadcast = sc.broadcast('Hello, World');
newRdd = myRdd.map(@(x) myBroadcast.value);
countdata = newRdd.collect()

Version History

Introduced in R2016b