1
我試圖捕獲greenlet中引發的異常。根據this tutorial,不幸的是'在Greenlet提出的例外,留在Greenlet'。在下面的代碼中,我有一個生成爬網小程序的同步方法。那些抓取greenlet引發了HTTPError異常,我需要在同步方法的主體中捕獲這個異常。根據例外情況,在同步方法中,我將設置Account對象的適當狀態。任何想法如何捕獲同步方法中的greenlet中引發的異常,以實現這一點?先謝謝你!在greenlets中引發異常
# this is standalone helper method
def crawl(item):
try:
item.refresh_children(False) # THROWS HTTPError exception
greenlets = [gevent.spawn_link_exception(crawl, child) for child in item.children]
gevent.joinall(greenlets)
except HTTPError, e:
print e.message
raise e
except (JSONDecodeError, InvalidCredentialsException) as e:
print e.message
raise e
# this is instance method of the Account class
def sync(self):
"Sync search index with data from source"
try:
greenlets = [gevent.spawn_link_exception(crawl, item) for item in self.get_navigation()]
gevent.joinall(greenlets)
self.date_synced = datetime.datetime.now()
self.save()
except HTTPError, e:
if e.status_code == 401:
self.status = 'revoked'
else:
self.status = 'error'
self.save()
except LinkedFailed, e:
print e.message
exception_name = e.message.split()[-1]
if exception_name in ['HTTPError', 'JSONDecodeError']:
self.status = 'error'
self.save()
elif exception_name == 'InvalidCredentialsException':
self.status = 'revoked'
self.save()