獲取所有錶行，不默認情況下使用BeautifulSoup

Question

我試圖刮掉以下站點中的所有表數據： https://report.boonecountymo.org/mrcjava/servlet/SH01_MP.I00290s

表共有230行（不包括標題行），但默認爲前50行。當我點擊桌面上的下一頁按鈕（箭頭）時，會加載一個或多個新的組，但網頁不會更改。我如何使用BeautifulSoup獲取所有230行而不是僅默認的50行？

這是我使用的代碼：

import csv 
import requests 
from bs4 import BeautifulSoup 

url = "http://www.showmeboone.com/sheriff/JailResidents/JailResidents.asp" 
response = requests.get(url) 
html = response.content 

soup = BeautifulSoup(html,"html.parser") 
table = soup.find('tbody', attrs={'class':'stripe'}) 

list_of_rows = [] 
for row in table.findAll('tr'): 
    list_of_cells = [] 
    for cell in row.findAll('td'): 
     text = cell.text.replace(' ', '') 
     list_of_cells.append(text) 
    list_of_rows.append(list_of_cells[1:]) 

outfile = open("./inmates.csv", "w", newline='') 
writer = csv.writer(outfile) 
writer.writerow(["Last", "First", "Middle", "Gender", "Race", "Age", "City", "State"]) 
writer.writerows(list_of_rows) 

Answer 1

可以設置max_rows參數中的URL：

https://report.boonecountymo.org/mrcjava/servlet/SH01_MP.I00290s?max_rows=500