WSO2 Storage Server ships preconfigured HDFS file system. In the default configuration HDFS is disabled and user has to enable it by disabling the system variable named disable.hdfs.startup in $CARBON $SS_HOME/bin/wso2server.sh
.
Code Block | ||
---|---|---|
| ||
enable.hdfs.startup=true |
HDFS Name Node
1. To start HDFS name node, open a command prompt (in Windows) or a text Linux console (in Linux) in $SS_HOME
/bin
directory and execute wso2server.bat (in Windows) or or wso2server.sh (in Linux).
2. To disable HDFS name node at the Storage Server start-up, execute the above command with the following properties.
Code Block |
---|
bin/wso2server.sh -Ddisable.hdfs.namenode.startup=true |
3. To introduce a star-tup delay to name node:
Code Block |
---|
bin/wso2server.sh -Dhdfs.namenode.startup.delay=400000 |
HDFS Data Node
1. HDFS Data Node
Info |
---|
Do not format a running Hadoop file system, this will cause all your data to be erased. Before formatting, ensure that the dfs.name.dir directory exists. |
To start the HDFS data node, change the directory to $SS_HOME .
HADOOP_SECURE_DN_USER=<user> sudo -E bin/hadoop datanode
The user should have sudo privileges.
2. To format HDFS name node,
cache the file system related user ticket:
Code Block |
---|
$kinit hdfs/node0 |
Next, change the directory to $SS_HOME and execute:
...