如何從配置單元表中刪除字符串列中的重複項

Question

我有用重複值分隔的列（字符串）空間。我想刪除重複項：

column_name 
----------------- 
gun gun man gun man 
shuttle enemy enemy run 
hit chase 

我想導致這樣的：

column_name 
---------------- 
gun man 
shuttle enemy run 
hit chase 

我使用蜂巢database.Please幫助。

Answer 1

沒有自定義的UDF，這是一個只有查詢的方法。

select id, concat_ws(' ',collect_set(splited)) as column_name 
from 
(
    select id, splited 
    from tbl_name 
    LATERAL VIEW explode(split(column_name,' ')) t as splited 
    group by id, splited 
) x 
group by id