# HBase 원격 접속 오류

> HBase master 서버에 직접 접속한 상태에서는 정상적인 작업이 진행 되지만, 외부에서 접근시 아래와 같은 오류가 발생하는 경우

java.net.SocketTimeoutException: callTimeout=600000, callDuration=863625:
    at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:156)
    at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3390)
    at org.apache.hadoop.hbase.client.HBaseAdmin.disableTableAsync(HBaseAdmin.java:935)
    at org.apache.hadoop.hbase.client.HBaseAdmin.disableTable(HBaseAdmin.java:967)
    at org.apache.hadoop.hbase.client.HBaseAdmin.disableTable(HBaseAdmin.java:1002)
    at iq_project.hbase_test_0_1.HBase_Test.tFixedFlowInput_1Process(HBase_Test.java:1032)
    at iq_project.hbase_test_0_1.HBase_Test.tJava_1Process(HBase_Test.java:442)
    at iq_project.hbase_test_0_1.HBase_Test.runJobInTOS(HBase_Test.java:1700)
    at iq_project.hbase_test_0_1.HBase_Test.main(HBase_Test.java:1527)
Caused by: org.apache.hadoop.hbase.MasterNotRunningException: java.io.IOException: Can't get master address from ZooKeeper; znode data == null
    at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStub(ConnectionManager.java:1627)
    at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$MasterServiceStubMaker.makeStub(ConnectionManager.java:1653)
    at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getKeepAliveMasterService(ConnectionManager.java:1860)
    at org.apache.hadoop.hbase.client.HBaseAdmin$MasterCallable.prepare(HBaseAdmin.java:3363)
    at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:125)
    ... 8 more
Caused by: java.io.IOException: Can't get master address from ZooKeeper; znode data == null
    at org.apache.hadoop.hbase.zookeeper.MasterAddressTracker.getMasterAddress(MasterAddressTracker.java:114)
    at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStubNoRetries(ConnectionManager.java:1554)
    at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStub(ConnectionManager.java:1599)
    ... 12 more


> 원인 : 원격지 Client에서 HBase master에 접근할 수 있는 Z 노드(zookeeper.znode.parent) 경로가 없을때 발생
             보안 서비스가 실행중일경우에는 /hbase-secure 상태로 변경


> zookeeper.znode.parent 경로 확인

1) 설정 파일에서 확인 : $HBASE_HOME/conf/hbase-site.xml
    <property>
      <name>zookeeper.znode.parent</name>
      <value>/hbase-unsecure</value>
    </property>

2) HBase shell 에서 확인
hbase(main):001:0> zk_dump
HBase is rooted at /hbase-unsecure
Active master address: single.iqdp,16000,1446957095899
Backup master addresses:
Region server holding hbase:meta: single.iqdp,16020,1446957107759
Region servers:
 single.iqdp,16020,1446957107759
/hbase-unsecure/replication:
/hbase-unsecure/replication/peers:
/hbase-unsecure/replication/rs:
/hbase-unsecure/replication/rs/single.iqdp,16020,1446957107759:
Quorum Server Statistics:
 single.iqdp:2181
  Zookeeper version: 3.4.6-2950--1, built on 09/30/2015 17:44 GMT
  Clients:
   /192.168.1.14:59999[1](queued=0,recved=19186,sent=19186)
   /192.168.1.14:56554[1](queued=0,recved=5812,sent=5812)
   /192.168.1.14:39439[1](queued=0,recved=12,sent=12)
   /192.168.1.14:56551[1](queued=0,recved=11496,sent=11551)
   /192.168.1.14:39424[1](queued=0,recved=4,sent=4)
   /192.168.1.14:58305[1](queued=0,recved=77885,sent=77885)
   /192.168.1.14:56563[1](queued=0,recved=5959,sent=5959)
   /192.168.1.14:56564[1](queued=0,recved=5813,sent=5813)
   /192.168.1.14:56572[1](queued=0,recved=5811,sent=5811)
   /192.168.1.14:56552[1](queued=0,recved=5816,sent=5816)
   /192.168.1.14:56555[1](queued=0,recved=6673,sent=6673)
   /192.168.1.14:39443[0](queued=0,recved=1,sent=0)
 
  Latency min/avg/max: 0/0/28
  Received: 271514
  Sent: 271798
  Connections: 12
  Outstanding: 0
  Zxid: 0x142e
  Mode: standalone
  Node count: 873

> Client에 Z 노드(zookeeper.znode.parent) 값 설정

1) Java 소스상에서의 속성 값 설정
    Configuration conf = HBaseConfiguration.create();
    
    conf.clear();
    conf.set("hbase.zookeeper.quorum", "zookeeper_host");
    conf.set("zookeeper.znode.parent", "/hbase-unsecure");


2) TOSBD(Talend Open Studio for Big Data) 의 설정

사용자 삽입 이미지







※ 위 내용은, 여러 자료를 참고하거나 제가 주관적으로 정리한 것입니다.
   잘못된 정보나 보완이 필요한 부분을, 댓글 또는 메일로 보내주시면 많은 도움이 되겠습니다.

"BigData / HBase" 분류의 다른 글

HBase - 데이터 모델 이해 정리 (0)2015/11/08
11 9, 2015 20:21 11 9, 2015 20:21


Trackback URL : http://develop.sunshiny.co.kr/trackback/1042

Leave a comment


Recent Posts

  1. HDFS - Python Encoding 오류 처리
  2. HP - Vertica ROS Container 관련 오류...
  3. HDFS - Hive 실행시 System Time 오류
  4. HP - Vertica 사용자 쿼리 이력 테이블...
  5. Client에서 HDFS 환경의 데이터 처리시...

Recent Comments

  1. 안녕하세요^^ 배그핵
  2. 안녕하세요^^ 도움이 되셨다니, 저... sunshiny
  3. 정말 큰 도움이 되었습니다.. 감사합... 사랑은
  4. 네, 안녕하세요. 댓글 남겨 주셔서... sunshiny
  5. 감사합니다 많은 도움 되었습니다!ㅎㅎ 프리시퀸스

Recent Trackbacks

  1. chatbots chatbots %M
  2. london relocation agents london relocation agents %M
  3. how to build chatbot how to build chatbot %M
  4. advanced chatbot advanced chatbot %M
  5. facebook ai chatbot facebook ai chatbot %M

Calendar

«   08 2019   »
        1 2 3
4 5 6 7 8 9 10
11 12 13 14 15 16 17
18 19 20 21 22 23 24
25 26 27 28 29 30 31

Bookmarks

  1. 위키피디아
  2. MysqlKorea
  3. 오라클 클럽
  4. API - Java
  5. Apache Hadoop API
  6. Apache Software Foundation
  7. HDFS 생태계 솔루션
  8. DNSBL - Spam Database Lookup
  9. Ready System
  10. Solaris Freeware
  11. Linux-Site
  12. 윈디하나의 솔라나라

Site Stats

TOTAL 2660960 HIT
TODAY 1276 HIT
YESTERDAY 1540 HIT