Java access remote HDFS from current Hadoop cluster

Suppose we have our Java app running on Hadoop clusterA, and we want to access remote HDFS based on Hadoop clusterB. Let’s see how we can do it: You need to go to clusterB and gather core-site.xml and hdfs-site.xml from there (default location for Cloudera is /etc/hadoop/conf) and put near your app running in clusterA. […]

READ MORE

Apache Curator: Invalid config event received

The exception looks like this: We know, that in zookeeper.properties (or zoo.cfg) there is a cluster configuration of the following type: From a certain version of ZooKeeper, it became like this https://zookeeper.apache.org/doc/r3.5.3-beta/zookeeperReconfig.html#ch_reconfig_format: Apache Curator switched to a new format, discontinuing support for the old one. However, ZooKeeper kept it: on the same page in the […]

READ MORE