Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

WSO2 Storage Server ships preconfigured HDFS file system. In the default configuration HDFS is disabled and user has to enable it by disabling the system variable named disable.hdfs.startup in $CARBON $SS_HOME/bin/wso2server.sh.

Code Block
languagebash
enable.hdfs.startup=true

 

HDFS Name Node

1. To start HDFS name node, open a command prompt (in Windows) or a text Linux console (in Linux) in $SS_HOME/bin directory and execute wso2server.bat (in Windows) or  or wso2server.sh (in Linux). 

2. To disable HDFS name node at the Storage Server start-up, execute the above command with the following properties.

Code Block
bin/wso2server.sh -Ddisable.hdfs.namenode.startup=true

3. To introduce a star-tup delay to name node: 

Code Block
bin/wso2server.sh -Dhdfs.namenode.startup.delay=400000
HDFS Data Node 

1. HDFS Data Node 

Info

Do not format a running Hadoop file system, this will cause all your data to be erased. Before formatting, ensure that the dfs.name.dir directory exists.

To start the HDFS data node, change the directory to $SS_HOME  .

HADOOP_SECURE_DN_USER=<user> sudo -E bin/hadoop datanode
 
The user should have sudo privileges.
 2. To format HDFS name node,

 cache the file system related user ticket:

Code Block
$kinit hdfs/node0

Next, change the directory to $SS_HOME and execute:

...