You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

634 B

This file contains invisible Unicode characters!

This file contains invisible Unicode characters that may be processed differently from what appears below. If your use case is intentional and legitimate, you can safely ignore this warning. Use the Escape button to reveal hidden characters.

This file contains ambiguous Unicode characters that may be confused with others in your current locale. If your use case is intentional and legitimate, you can safely ignore this warning. Use the Escape button to highlight these characters.

一、安装

D:/env/docker-compose/spark

docker-compose up -d

启动Hadoop

  1. 进入master 节点,执行./start-hadoop.sh

二、webUI

spark 集群管理 hdfs管理 YARN

三、FAQ

WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

hadoop 2.x安装不能加载本地库 - java.library.path错误 - 爱码网 (likecs.com)

需要修改hadoop-env.sh文件配置