從CSV提取行基於文件的特定關鍵字

Question

enter image description here我創建了一個代碼，以幫助我檢索從csv文件

import re 
keywords = {"metal", "energy", "team", "sheet", "solar" "financial", "transportation", "electrical", "scientists", 
      "electronic", "workers"} # all your keywords 


keyre=re.compile("energy",re.IGNORECASE) 
with open("2006-data-8-8-2016.csv") as infile: 
    with open("new_data.csv", "w") as outfile: 
     outfile.write(infile.readline()) # Save the header 
     for line in infile: 
      if len(keyre.findall(line))>0: 
       outfile.write(line) 

我需要它來查找每個關鍵字，其中有兩個主要的列中的數據「位置「和」職位描述「，然後將包含這些單詞的整行寫入新文件中。關於如何以最簡單的方式完成這些任何想法？

Answer 1

試試這個，在數據框中循環並將新的數據框寫回csv文件。

import pandas as pd 

keywords = {"metal", "energy", "team", "sheet", "solar", "financial", 
     "transportation", "electrical", "scientists", 
     "electronic", "workers"} # all your keywords 

df = pd.read_csv("2006-data-8-8-2016.csv", sep=",") 

listMatchPosition = [] 
listMatchDescription = [] 

for i in range(len(df.index)): 
    if any(x in df['position'][i] or x in df['Job description'][i] for x in keywords): 
     listMatchPosition.append(df['position'][i]) 
     listMatchDescription.append(df['Job description'][i]) 


output = pd.DataFrame({'position':listMatchPosition, 'Job description':listMatchDescription}) 
output.to_csv("new_data.csv", index=False) 

編輯： 如果你有許多列添加，修改下面的代碼將做的工作。

df = pd.read_csv("2006-data-8-8-2016.csv", sep=",") 

output = pd.DataFrame(columns=df.columns) 

for i in range(len(df.index)): 
    if any(x in df['position'][i] or x in df['Job description'][i] for x in keywords): 
    output.loc[len(output)] = [df[j][i] for j in df.columns] 

output.to_csv("new_data.csv", index=False) 

Answer 2

你可以做到這一點使用熊貓如下，如果你正在尋找含有關鍵字的列表中只有一個字行：

keywords = ["metal", "energy", "team", "sheet", "solar" "financial", "transportation", "electrical", "scientists", 
      "electronic", "workers"] 

# read the csv data into a dataframe 
# change "," to the data separator in your csv file 
df = pd.read_csv("2006-data-8-8-2016.csv", sep=",") 
# filter the data: keep only the rows that contain one of the keywords 
# in the position or the Job description columns 
df = df[df["position"].isin(keywords) | df["Job description"].isin(keywords)] 
# write the data back to a csv file 
df.to_csv("new_data.csv",sep=",", index=False) 

如果你正在尋找的行子（例如，在尋找financial engineeringfinancial），那麼你可以做到以下幾點：

keywords = ["metal", "energy", "team", "sheet", "solar" "financial", "transportation", "electrical", "scientists", 
      "electronic", "workers"] 
searched_keywords = '|'.join(keywords) 

# read the csv data into a dataframe 
# change "," to the data separator in your csv file 
df = pd.read_csv("2006-data-8-8-2016.csv", sep=",") 
# filter the data: keep only the rows that contain one of the keywords 
# in the position or the Job description columns 
df = df[df["position"].str.contains(searched_keywords) | df["Job description"].str.contains(searched_keywords)] 
# write the data back to a csv file 
df.to_csv("new_data.csv",sep=",", index=False)