如何使用Java將JavaDStream <String>存儲到Spark中的Hive表？

Question

我正在將來自Kafka服務器的消息接收到JavaDStream對象中。現在我想將這些消息存儲到配置單元表中。我怎樣才能做到這一點？

從卡夫卡流接收消息的代碼片段：在蜂房

JavaPairReceiverInputDStream<String, String> kafkaStream = KafkaUtils.createStream(jssc, zookeperIp, consumerGroup, 
      topic); 

JavaDStream<String> messageData = kafkaStream.map(new Function<Tuple2<String, String>, String>() { 

    @Override 
    public String call(Tuple2<String, String> message) throws Exception { 
     // TODO Auto-generated method stub 
     return message._2; 
    } 

}); 

架構爲表：

create external table sample(value STRING); 

我使用的火花2.1.0版本。

Answer 1

請看看這些官方編程指南。

You can easily use DataFrames and SQL operations on streaming data

和Spark SQL also supports reading and writing data stored in Apache Hive