2016-11-27 47 views
-1

如何計算火花中的2列?計數2個元素星火

我測試一下。但是,這不是好辦法..

joinDF = logDF.join(logDF2,"day_number") 
compareNumberRequestTraffic = joinDF.groupBy("day_number") \ 
    .agg(functions.count("request","request2")) \ 
    .show() 

我有錯誤:

() takes exactly 1 argument (2 given) 

我想噸對產出

day_number  count(request)  count(request2) 
2015-01-03    5     7 

非常感謝

+0

對不起,我編輯問題@GrantWinney – JackR

回答

1

不要寫用2個參數計數,但2個計數在agg函數中

joinDF = logDF.join(logDF2,"day_number") 
compareNumberRequestTraffic = joinDF.groupBy("day_number") \ 
    .agg(functions.count("request"), functions.count("request2")) \ 
    .show()