Apache Flink: Difference between revisions
Jump to navigation
Jump to search
| Line 17: | Line 17: | ||
==Local Execution== |
==Local Execution== |
||
Terminal 1: start Flink |
|||
<pre> |
<pre> |
||
cd $FLINK_HOME |
cd $FLINK_HOME |
||
| Line 25: | Line 25: | ||
Open the UI http://localhost:8081/#/overview |
Open the UI http://localhost:8081/#/overview |
||
[[Image:flink-ui.png|thumb|right|500px|Flink UI]] |
[[Image:flink-ui.png|thumb|right|500px|Flink UI]] |
||
| ⚫ | |||
| ⚫ | |||
| ⚫ | |||
| ⚫ | |||
Run the SocketWindowWordCount example ([https://github.com/apache/flink/blob/master/flink-examples/flink-examples-streaming/src/main/java/org/apache/flink/streaming/examples/socket/SocketWindowWordCount.java source]). |
Run the SocketWindowWordCount example ([https://github.com/apache/flink/blob/master/flink-examples/flink-examples-streaming/src/main/java/org/apache/flink/streaming/examples/socket/SocketWindowWordCount.java source]). |
||
Terminal |
Terminal 2: Start netcat |
||
<pre> |
<pre> |
||
nc -l 9000 |
nc -l 9000 |
||
| Line 41: | Line 34: | ||
Submit the Flink program: |
Terminal 3: Submit the Flink program: |
||
<pre> |
<pre> |
||
| ⚫ | |||
bin/flink run examples/streaming/SocketWindowWordCount.jar --port 9000 |
bin/flink run examples/streaming/SocketWindowWordCount.jar --port 9000 |
||
</pre> |
</pre> |
||
Terminal |
Terminal 2: Add words in netcat input |
||
<pre> |
<pre> |
||
lorem ipsum |
lorem ipsum |
||
| Line 55: | Line 49: | ||
Terminal |
Terminal 4: |
||
<pre> |
<pre> |
||
cd $FLINK_HOME |
|||
tail -f log/flink-*-jobmanager-*.out |
tail -f log/flink-*-jobmanager-*.out |
||
</pre> |
</pre> |
||
| Line 62: | Line 57: | ||
Terminal |
Terminal 1: stop Flink |
||
<pre> |
<pre> |
||
cd $FLINK_HOME |
|||
bin/stop-local.sh |
bin/stop-local.sh |
||
</pre> |
</pre> |
||
==Shell== |
|||
| ⚫ | |||
cd $FLINK_HOME |
|||
| ⚫ | |||
| ⚫ | |||
TBC |
|||
==Cluster execution== |
==Cluster execution== |
||
Revision as of 04:39, 16 September 2016
Apache Flink® is an open source platform for distributed stream and batch data processing. Flink’s core is a streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations over data streams.
Getting started
Installation
wget http://www.apache.org/dyn/closer.lua/flink/flink-1.1.2/flink-1.1.2-bin-hadoop27-scala_2.11.tgz tar xf flink-1.1.2-bin-hadoop27-scala_2.11.tgz FLINK_HOME=~/flink-1.1.2 cd $FLINK_HOME ls bin ls examples
Local Execution
Terminal 1: start Flink
cd $FLINK_HOME bin/start-local.sh
Open the UI http://localhost:8081/#/overview
Run the SocketWindowWordCount example (source).
Terminal 2: Start netcat
nc -l 9000
Terminal 3: Submit the Flink program:
cd $FLINK_HOME bin/flink run examples/streaming/SocketWindowWordCount.jar --port 9000
Terminal 2: Add words in netcat input
lorem ipsum ipsum ipsum ipsum bye
Terminal 4:
cd $FLINK_HOME tail -f log/flink-*-jobmanager-*.out
Terminal 1: stop Flink
cd $FLINK_HOME bin/stop-local.sh
Shell
cd $FLINK_HOME bin/start-scala-shell.sh local
TBC