1. 首頁
  2. 問答
  3. MarkLogic：使用MLCP導入文件時出錯

MarkLogic：使用MLCP導入文件時出錯

2015-06-29 33 views
3

我嘗試使用MarkLogic內容泵在生產環境中運行的MarkLogic服務器中使用以下命令導入文件。MarkLogic：使用MLCP導入文件時出錯

C:\Users\Admin\Desktop\mlcp-1.3-3\bin>mlcp.bat import -host localhost -port 8891 -username admin -password admin -mode local -input_file_type archive -input_file_path /d:/NewFolder/

輸入文件路徑同時包含Binary和XML文件。

"D:\NewFolder\20150626200126+0800-000000-BINARY.zip" 
"D:\NewFolder\20150626200126+0800-000001-XML.zip"

當我試圖在命令提示符下運行導入命令。我收到了我不熟悉的以下回復。

15/06/29 16:53:11 INFO contentpump.ContentPump: Hadoop library version: 2.6.0 
15/06/29 16:53:11 INFO contentpump.LocalJobRunner: Content type: XML 
15/06/29 16:53:11 ERROR contentpump.ContentPump: Error running a ContentPump job 

java.lang.RuntimeException: Error while running command to get file permissions 
: ExitCodeException exitCode=-1073741515: 
    at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) 
    at org.apache.hadoop.util.Shell.run(Shell.java:455) 
    at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java: 
715) 
    at org.apache.hadoop.util.Shell.execCommand(Shell.java:808) 
    at org.apache.hadoop.util.Shell.execCommand(Shell.java:791) 
    at org.apache.hadoop.fs.FileUtil.execCommand(FileUtil.java:1097) 
    at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus. 
loadPermissionInfo(RawLocalFileSystem.java:582) 
    at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus. 
getPermission(RawLocalFileSystem.java:557) 
    at org.apache.hadoop.fs.LocatedFileStatus.<init>(LocatedFileStatus.java: 
42) 
    at org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1699) 
    at org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1681) 
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedL 
istStatus(FileInputFormat.java:303) 
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(File 
InputFormat.java:264) 
    at com.marklogic.contentpump.FileAndDirectoryInputFormat.getSplits(FileA 
ndDirectoryInputFormat.java:80) 
    at com.marklogic.contentpump.ArchiveInputFormat.getSplits(ArchiveInputFo 
rmat.java:56) 
    at com.marklogic.contentpump.LocalJobRunner.run(LocalJobRunner.java:128) 

    at com.marklogic.contentpump.ContentPump.runJobLocally(ContentPump.java: 
307) 
    at com.marklogic.contentpump.ContentPump.runCommand(ContentPump.java:204 
) 
    at com.marklogic.contentpump.ContentPump.main(ContentPump.java:67) 

    at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus. 
loadPermissionInfo(RawLocalFileSystem.java:620) 
    at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus. 
getPermission(RawLocalFileSystem.java:557) 
    at org.apache.hadoop.fs.LocatedFileStatus.<init>(LocatedFileStatus.java: 
42) 
    at org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1699) 
    at org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1681) 
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedL 
istStatus(FileInputFormat.java:303) 
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(File 
InputFormat.java:264) 
    at com.marklogic.contentpump.FileAndDirectoryInputFormat.getSplits(FileA 
ndDirectoryInputFormat.java:80) 
    at com.marklogic.contentpump.ArchiveInputFormat.getSplits(ArchiveInputFo 
rmat.java:56) 
    at com.marklogic.contentpump.LocalJobRunner.run(LocalJobRunner.java:128) 

    at com.marklogic.contentpump.ContentPump.runJobLocally(ContentPump.java: 
307) 
    at com.marklogic.contentpump.ContentPump.runCommand(ContentPump.java:204 
) 
    at com.marklogic.contentpump.ContentPump.main(ContentPump.java:67) 
java.lang.RuntimeException: Error while running command to get file  permissions 
: ExitCodeException exitCode=-1073741515: 
    at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) 
    at org.apache.hadoop.util.Shell.run(Shell.java:455) 
    at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java: 
715) 
    at org.apache.hadoop.util.Shell.execCommand(Shell.java:808) 
    at org.apache.hadoop.util.Shell.execCommand(Shell.java:791) 
    at org.apache.hadoop.fs.FileUtil.execCommand(FileUtil.java:1097) 
    at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus. 
loadPermissionInfo(RawLocalFileSystem.java:582) 
    at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus. 
getPermission(RawLocalFileSystem.java:557) 
    at org.apache.hadoop.fs.LocatedFileStatus.<init>(LocatedFileStatus.java: 
42) 
    at org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1699) 
    at org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1681) 
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedL 
istStatus(FileInputFormat.java:303) 
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(File 
InputFormat.java:264) 
    at com.marklogic.contentpump.FileAndDirectoryInputFormat.getSplits(FileA 
ndDirectoryInputFormat.java:80) 
    at com.marklogic.contentpump.ArchiveInputFormat.getSplits(ArchiveInputFo 
rmat.java:56) 
    at com.marklogic.contentpump.LocalJobRunner.run(LocalJobRunner.java:128) 

    at com.marklogic.contentpump.ContentPump.runJobLocally(ContentPump.java: 
307) 
    at com.marklogic.contentpump.ContentPump.runCommand(ContentPump.java:204 
) 
    at com.marklogic.contentpump.ContentPump.main(ContentPump.java:67) 

    at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus. 
loadPermissionInfo(RawLocalFileSystem.java:620) 
    at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus. 
getPermission(RawLocalFileSystem.java:557) 
    at org.apache.hadoop.fs.LocatedFileStatus.<init>(LocatedFileStatus.java: 
42) 
    at org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1699) 
    at org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1681) 
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedL 
istStatus(FileInputFormat.java:303) 
    at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(File 
InputFormat.java:264) 
    at com.marklogic.contentpump.FileAndDirectoryInputFormat.getSplits(FileA 
ndDirectoryInputFormat.java:80) 
    at com.marklogic.contentpump.ArchiveInputFormat.getSplits(ArchiveInputFo 
rmat.java:56) 
    at com.marklogic.contentpump.LocalJobRunner.run(LocalJobRunner.java:128) 

    at com.marklogic.contentpump.ContentPump.runJobLocally(ContentPump.java: 
307) 
    at com.marklogic.contentpump.ContentPump.runCommand(ContentPump.java:204 
) 
    at com.marklogic.contentpump.ContentPump.main(ContentPump.java:67)

任何人都可以幫我解決這個問題嗎？

謝謝。

來源

2015-06-29 Gowtham

+0

「/ d：/ NewFolder /」是否正確？ – sss4r

+0

@ sss4r亞其正確的上述imort命令工作正常，如果我從我的本地運行 – Gowtham

+0

啊，好吧，只是檢查 - 我只用了幾次mlcp，並且語法對我來說看起來並不熟悉。 – sss4r

回答

0

輸入文檔是否使用輸出內容的結果MLCP？這似乎是-input_file_type存檔的目的。如果這不是文檔的來源，請嘗試-input_file_type documents -input_compressed true。

來源

2015-07-17 11:06:00

+0

是的，輸入文檔使用MLCP導出，它具有文件和元數據，並從不同的服務器導出。 – Gowtham

+0

這兩種環境下的MarkLogic版本是否相同？什麼版本？ –

+0

文檔中的[Windows MLCP示例]（https://docs.marklogic.com/guide/ingestion/content-pump#id_56922）顯示「-input_file_path C：\ space \ bill」 - 您可以嘗試一下，而不是「-input_file_path/d：/ NewFolder /」？ 「運行命令獲取文件權限時出現錯誤」表明MLCP無法找到或讀取輸入文件。 –

1

我在做MarkLogic大學課程XQuery II時遇到了同樣的錯誤。 他們在課程中提供的虛擬機非常慢，所以我在Parallels中安裝了自己的Windows 7虛擬機。

當我跑這從單位6： mlcp.bat import -host localhost -port 8012 -username admin -password admin -input_file_path C:\mls-developer-2\socialmedia\content\enriched -mode local -input_file_pattern "disqus.*\.xml" -output_uri_replace "C:/mls-developer-2/socialmedia/content/enriched, 'socialmedia/disqus'"

我給你看我試着設置_JAVA_OPTIONS增加可用的JVM內存爲一些職位提出了同樣的錯誤...... 但沒有影響。

我最終得到了命令，改成上班「 disqus * XML」 mlcp.bat import -host localhost -port 8012 -username admin -password admin -input_file_path "C:\mls-developer-2\socialmedia\content\enriched\*.xml" -mode local -output_uri_replace "C:/mls-developer-2/socialmedia/content/enriched, 'socialmedia/disqus'"

有一些關於input_file_pattern，它不喜歡。在你的情況下，它看起來不是一回事，但我想我會在這裏爲其他人發佈我的問題。

來源

2015-12-03 20:16:35

相關問題

 相關問題