如何從日誌文件提取XML在python

解析我有包含XML信封（2種類型的XML結構的：請求和響應）的日誌文件。我需要做的是分析此文件，提取XML-S並把它們放到2個數組作爲字符串（請求和響應的第2個數組第1個數組），所以我可以在以後解析。如何從日誌文件提取XML在python

任何想法如何我可以在Python實現這一目標？日誌文件的

片段被解析（日誌包含）：

2014-10-31 12:27:33,600 INFO Recharger_MTelemedia2Channel [mbpa.module.mgw.mtelemedia.mtbilling.MTSender][] Sending BILL request 
2014-10-31 12:27:33,601 INFO Recharger_MTelemedia2Channel [mbpa.module.mgw.mtelemedia.mtbilling.MTSender][] <?xml version="1.0" encoding="UTF-8"?> 
<request xmlns="XXX" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"> 
    <transactionheader> 
      <username>XXX</username> 
      <password>XXX</password> 
      <time>31/10/2014 12:27:33</time> 
      <clientreferencenumber>123</clientreferencenumber> 
      <numberrequests>3</numberrequests> 
      <information>Description</information> 
      <postbackurl>http://localhost/status</postbackurl> 
    </transactionheader> 
    <transactiondetails> 
      <items> 
        <item id="1" client="XXX1" keyword="test"/> 
        <item id="2" client="XXX2" keyword="test"/> 
        <item id="3" client="XXX3" keyword="test"/> 
      </items> 
    </transactiondetails> 
</request> 
2014-10-31 12:27:34,487 INFO Recharger_MTelemedia2Channel [mbpa.module.mgw.mtelemedia.mtbilling.MTSender][] Response code 200 for bill request 
2014-10-31 12:27:34,489 INFO Recharger_MTelemedia2Channel [mbpa.module.mgw.mtelemedia.mtbilling.MTSender][] <?xml version="1.0" encoding="UTF-8"?> 

<response xmlns="XXX" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> 
    <serverreferencenumber>XXX123XXX</serverreferencenumber> 
    <clientreferencenumber>123</clientreferencenumber> 
    <information>Queued for Processing</information> 
    <status>OK</status> 
</response>

的答覆非常感謝！

問候，羅伯特

來源

2014-10-31 Robert Jonczy

使用像etree解析器：https://docs.python.org/2/library/xml.etree.elementtree.html – Paco 2014-10-31 10:36:31

使用正則表達式identifiing他們後刪除非XML線，然後一個標準的解析器會做。除了XML解析（beautifulsoup對我很好）我會把請求和響應放在字典中，請求作爲關鍵字。 – 2014-10-31 10:43:42

由於@Paco和@Lord_Gestalter兩個建議，你可以使用xml.etree並從文件替換非XML元素，像這樣：

# I use re to substitute non-XML elements 
import re 
# then use xml module as a parser 
import xml.etree.ElementTree as ET 

# read your file and store in string 's' 
with open('yourfilehere','r') as f: 
    s = f.read() 
# then remove non-XML element with re 
# I also remove <?xml ...?> part as your file consists of multiple xml logs 
s = re.sub(r'<\?xml.*?>', '', ''.join(re.findall(r'<.*>', s))) 
# wrap your s with a root element 
s = '<root>'+s+'</root>' 
# parse s with ElementTree 
tree = ET.fromstring(s) 

tree 
<Element 'root' at 0x7f2ab877e190>

如果你不關心xml解析器，只想'請求'&'響應'字符串，請使用re.search

with open('yourfilehere','r') as f: 
    s = f.read()  
# put the string of both request and response into 'req' and 'res' 
# or you need to construct a better re.search if you have multiple requests, responses 
req = [re.search(r'<request.*\/request>', s).group()] 
res = [re.search(r'<response.*\/response>', s).group()] 

req 
['<request xmlns="XXX" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"><transactionheader><username>XXX</username><password>XXX</password><time>31/10/2014 12:27:33</time><clientreferencenumber>123</clientreferencenumber><numberrequests>3</numberrequests><information>Description</information><postbackurl>http://localhost/status</postbackurl></transactionheader><transactiondetails><items><item id="1" client="XXX1" keyword="test"/><item id="2" client="XXX2" keyword="test"/><item id="3" client="XXX3" keyword="test"/></items></transactiondetails></request>'] 

res 
['<response xmlns="XXX" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><serverreferencenumber>XXX123XXX</serverreferencenumber><clientreferencenumber>123</clientreferencenumber><information>Queued for Processing</information><status>OK</status></response>']

來源

2014-10-31 11:28:25 Anzel

非常感謝！這正是我一直在尋找的！ – 2014-11-01 23:41:40

如何從日誌文件提取XML在python

回答

相關問題