如何使用caffe從自己的數據集生成coorectlly lmdb文件？

Question

我試圖用Caffe來生成lmdbs來訓練我的CNN。

我已經用作數據集斯坦福狗數據集。下載數據集後，我準備了訓練數據集和測試數據集。我將配置保存到文件train.txt和val.txt中。

於是，我試圖生成我的控制檯上由這兩個以下命令lmdb文件：

GLOG_logtostderr=1 /home/bme/caffe/build/tools/convert_imageset \ 
    --resize_height=200 --resize_width=200 --shuffle \ 
    /home/bme/caffe/data/dogs/data/ \ 
    /home/bme/caffe/data/dogs/dogs_data/train.txt \ 
    /home/bme/caffe/examples/dogs/dogs_train_lmdb 

GLOG_logtostderr=1 /home/bme/caffe/build/tools/convert_imageset \ 
    --resize_height=200 --resize_width=200 --shuffle \ 
    /home/bme/caffe/data/dogs/data/ \ 
    /home/bme/caffe/data/dogs/dogs_data/val.txt \ 
    /home/bme/caffe/examples/dogs/dogs_val_lmdb 

但是，它生產的第一命令的錯誤：

I0331 18:13:39.625823 8810 convert_imageset.cpp:86] Shuffling data 
I0331 18:13:39.627516 8810 convert_imageset.cpp:89] A total of 17493 images. 
I0331 18:13:39.627708 8810 db_lmdb.cpp:35] Opened lmdb /home/bme/caffe/examples/dogs/dogs_train_lmdb 
E0331 18:13:39.627734 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/108_n02111889-Samoyed17.jpg 108 
E0331 18:13:39.627743 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/12_n02104365-schipperke145.jpg 12 
E0331 18:13:39.627753 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/17_n02113712-miniature_poodle107.jpg 17 
E0331 18:13:39.627760 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/12_n02104365-schipperke63.jpg 12 
E0331 18:13:39.627768 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/97_n02105056-groenendael102.jpg 97 
E0331 18:13:39.627774 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/74_n02096585-Boston_bull38.jpg 74 
E0331 18:13:39.627781 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/4_n02113799-standard_poodle145.jpg 4 
E0331 18:13:39.627789 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/22_n02097047-miniature_schnauzer27.jpg 22 
E0331 18:13:39.627797 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/80_n02107312-miniature_pinscher167.jpg 80 
E0331 18:13:39.627805 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/95_n02091134-whippet42.jpg 95 

的錯誤第二個命令是：

I0331 18:13:39.625823 8810 convert_imageset.cpp:86] Shuffling data 
I0331 18:13:39.627516 8810 convert_imageset.cpp:89] A total of 17493 images. 
I0331 18:13:39.627708 8810 db_lmdb.cpp:35] Opened lmdb /home/bme/caffe/examples/dogs/dogs_train_lmdb 
E0331 18:13:39.627734 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/108_n02111889-Samoyed17.jpg 108 
E0331 18:13:39.627743 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/12_n02104365-schipperke145.jpg 12 
E0331 18:13:39.627753 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/17_n02113712-miniature_poodle107.jpg 17 
E0331 18:13:39.627760 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/12_n02104365-schipperke63.jpg 12 
E0331 18:13:39.627768 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/97_n02105056-groenendael102.jpg 97 
E0331 18:13:39.627774 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/74_n02096585-Boston_bull38.jpg 74 
E0331 18:13:39.627781 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/4_n02113799-standard_poodle145.jpg 4 
E0331 18:13:39.627789 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/22_n02097047-miniature_schnauzer27.jpg 22 
E0331 18:13:39.627797 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/80_n02107312-miniature_pinscher167.jpg 80 
E0331 18:13:39.627805 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/95_n02091134-whippet42.jpg 95 
E0331 18:13:39.627812 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/56_n02101556-clumber86.jpg 56 
E0331 18:13:39.627820 8810 io.cpp:80] Could not open or find file /home/bme/caffe/data/dogs/data/26_n02085782-Japanese_spaniel36.jpg 26 

我試圖通過更改權限來解決問題文件train.txt和val.txt的離子。但同樣的錯誤仍然存​​在。所以，有任何建議來解決這個問題。

謝謝

Answer 1

您發佈的輸出都是針對訓練集生成（它們是相同的）。它看起來像17493圖像中有12個損壞的文件，caffe無法找到/打開。
檢查這些文件是否存在，以及它們是否已損壞。