# HBase 원격 접속 오류

> HBase master 서버에 직접 접속한 상태에서는 정상적인 작업이 진행 되지만, 외부에서 접근시 아래와 같은 오류가 발생하는 경우

java.net.SocketTimeoutException: callTimeout=600000, callDuration=863625:
    at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:156)
    at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3390)
    at org.apache.hadoop.hbase.client.HBaseAdmin.disableTableAsync(HBaseAdmin.java:935)
    at org.apache.hadoop.hbase.client.HBaseAdmin.disableTable(HBaseAdmin.java:967)
    at org.apache.hadoop.hbase.client.HBaseAdmin.disableTable(HBaseAdmin.java:1002)
    at iq_project.hbase_test_0_1.HBase_Test.tFixedFlowInput_1Process(HBase_Test.java:1032)
    at iq_project.hbase_test_0_1.HBase_Test.tJava_1Process(HBase_Test.java:442)
    at iq_project.hbase_test_0_1.HBase_Test.runJobInTOS(HBase_Test.java:1700)
    at iq_project.hbase_test_0_1.HBase_Test.main(HBase_Test.java:1527)
Caused by: org.apache.hadoop.hbase.MasterNotRunningException: java.io.IOException: Can't get master address from ZooKeeper; znode data == null
    at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStub(ConnectionManager.java:1627)
    at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$MasterServiceStubMaker.makeStub(ConnectionManager.java:1653)
    at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getKeepAliveMasterService(ConnectionManager.java:1860)
    at org.apache.hadoop.hbase.client.HBaseAdmin$MasterCallable.prepare(HBaseAdmin.java:3363)
    at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:125)
    ... 8 more
Caused by: java.io.IOException: Can't get master address from ZooKeeper; znode data == null
    at org.apache.hadoop.hbase.zookeeper.MasterAddressTracker.getMasterAddress(MasterAddressTracker.java:114)
    at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStubNoRetries(ConnectionManager.java:1554)
    at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStub(ConnectionManager.java:1599)
    ... 12 more


> 원인 : 원격지 Client에서 HBase master에 접근할 수 있는 Z 노드(zookeeper.znode.parent) 경로가 없을때 발생
             보안 서비스가 실행중일경우에는 /hbase-secure 상태로 변경


> zookeeper.znode.parent 경로 확인

1) 설정 파일에서 확인 : $HBASE_HOME/conf/hbase-site.xml
    <property>
      <name>zookeeper.znode.parent</name>
      <value>/hbase-unsecure</value>
    </property>

2) HBase shell 에서 확인
hbase(main):001:0> zk_dump
HBase is rooted at /hbase-unsecure
Active master address: single.iqdp,16000,1446957095899
Backup master addresses:
Region server holding hbase:meta: single.iqdp,16020,1446957107759
Region servers:
 single.iqdp,16020,1446957107759
/hbase-unsecure/replication:
/hbase-unsecure/replication/peers:
/hbase-unsecure/replication/rs:
/hbase-unsecure/replication/rs/single.iqdp,16020,1446957107759:
Quorum Server Statistics:
 single.iqdp:2181
  Zookeeper version: 3.4.6-2950--1, built on 09/30/2015 17:44 GMT
  Clients:
   /192.168.1.14:59999[1](queued=0,recved=19186,sent=19186)
   /192.168.1.14:56554[1](queued=0,recved=5812,sent=5812)
   /192.168.1.14:39439[1](queued=0,recved=12,sent=12)
   /192.168.1.14:56551[1](queued=0,recved=11496,sent=11551)
   /192.168.1.14:39424[1](queued=0,recved=4,sent=4)
   /192.168.1.14:58305[1](queued=0,recved=77885,sent=77885)
   /192.168.1.14:56563[1](queued=0,recved=5959,sent=5959)
   /192.168.1.14:56564[1](queued=0,recved=5813,sent=5813)
   /192.168.1.14:56572[1](queued=0,recved=5811,sent=5811)
   /192.168.1.14:56552[1](queued=0,recved=5816,sent=5816)
   /192.168.1.14:56555[1](queued=0,recved=6673,sent=6673)
   /192.168.1.14:39443[0](queued=0,recved=1,sent=0)
 
  Latency min/avg/max: 0/0/28
  Received: 271514
  Sent: 271798
  Connections: 12
  Outstanding: 0
  Zxid: 0x142e
  Mode: standalone
  Node count: 873

> Client에 Z 노드(zookeeper.znode.parent) 값 설정

1) Java 소스상에서의 속성 값 설정
    Configuration conf = HBaseConfiguration.create();
    
    conf.clear();
    conf.set("hbase.zookeeper.quorum", "zookeeper_host");
    conf.set("zookeeper.znode.parent", "/hbase-unsecure");


2) TOSBD(Talend Open Studio for Big Data) 의 설정

사용자 삽입 이미지







※ 위 내용은, 여러 자료를 참고하거나 제가 주관적으로 정리한 것입니다.
   잘못된 정보나 보완이 필요한 부분을, 댓글 또는 메일로 보내주시면 많은 도움이 되겠습니다.

"BigData / HBase" 분류의 다른 글

HBase - 데이터 모델 이해 정리 (0)2015/11/08
11 9, 2015 20:21 11 9, 2015 20:21


Trackback URL : http://develop.sunshiny.co.kr/trackback/1042

Leave a comment
[로그인][오픈아이디란?]
오픈아이디로만 댓글을 남길 수 있습니다

« Previous : 1 : ... 13 : 14 : 15 : 16 : 17 : 18 : 19 : 20 : 21 : ... 648 : Next »

Recent Posts

  1. HDFS - Python Encoding 오류 처리
  2. HP - Vertica ROS Container 관련 오류...
  3. HDFS - Hive 실행시 System Time 오류
  4. HP - Vertica 사용자 쿼리 이력 테이블...
  5. Client에서 HDFS 환경의 데이터 처리시...

Recent Comments

  1. 안녕하세요^^ 배그핵
  2. 안녕하세요^^ 도움이 되셨다니, 저... sunshiny
  3. 정말 큰 도움이 되었습니다.. 감사합... 사랑은
  4. 네, 안녕하세요. 댓글 남겨 주셔서... sunshiny
  5. 감사합니다 많은 도움 되었습니다!ㅎㅎ 프리시퀸스

Recent Trackbacks

  1. print & mail services print & mail services 13 07
  2. montana fishing vacations montana fishing vacations 13 07
  3. decks colorado decks colorado 13 07
  4. phoenix az closet organizers phoenix az closet organizers 13 07
  5. useful reference useful reference 13 07

Calendar

«   07 2020   »
      1 2 3 4
5 6 7 8 9 10 11
12 13 14 15 16 17 18
19 20 21 22 23 24 25
26 27 28 29 30 31  

Bookmarks

  1. 위키피디아
  2. MysqlKorea
  3. 오라클 클럽
  4. API - Java
  5. Apache Hadoop API
  6. Apache Software Foundation
  7. HDFS 생태계 솔루션
  8. DNSBL - Spam Database Lookup
  9. Ready System
  10. Solaris Freeware
  11. Linux-Site
  12. 윈디하나의 솔라나라

Site Stats

TOTAL 3006620 HIT
TODAY 61 HIT
YESTERDAY 1048 HIT