WSO2 Storage Server ships preconfigured HDFS file system. In the default configuration HDFS is disabled and user has to enable it by disabling the system variable named disable.hdfs.startup in $CARBON $SS_HOME/bin/wso2server.sh.
| Code Block | ||
|---|---|---|
| ||
enable.hdfs.startup=true |
...
HDFS Name Node
1. To start HDFS name node, open a command prompt (in Windows) or a text Linux console (in Linux) in $SS_HOME/bin directory and execute wso2server.bat (in Windows) or or 1. wso2server.sh (in Linux).
2. To disable HDFS name node at the Storage Server start-up, execute the above command with the following properties.
| Code Block |
|---|
bin/wso2server.sh -Ddisable.hdfs.namenode.startup=true |
3. To introduce a star-tup delay to name node:
| Code Block |
|---|
bin/wso2server.sh -Dhdfs.namenode.startup.delay=400000 |
HDFS Data Node
HDFS Data Node
| Info |
|---|
Do not format a running Hadoop file system, this will cause all your data to be erased. Before formatting, ensure that the dfs.name.dir directory exists. The name node can be formatted by running the following command from the /wso2ss-1.1.0/bin location. ./hadoop namenode -format |
To start the HDFS data node, change the directory to $SS_HOME .
HADOOP_SECURE_DN_USER=<user> sudo -E bin/hadoop datanode
The user should have sudo privileges.
2. To format HDFS name node,
cache the file system related user ticket:
| Code Block |
|---|
$kinit hdfs/node0 |
Next, change the directory to $SS_HOME and execute:
...