以使用視覺API

我試圖在臉上繪製/油漆圖片？以使用視覺API

我試圖把在臉上繪製/油漆圖片，但我不能夠在同一畫面同時獲得。

我已經試過？

我已經嘗試過使用CameraSource.takePicture但我只是沒有任何繪製/繪畫的臉。

mPreview.setDrawingCacheEnabled(true); 
     Bitmap drawingCache = mPreview.getDrawingCache(); 
     try { 
      String mainpath = getExternalStorageDirectory() + separator + "TestXyz" + separator + "images" + separator; 
      File basePath = new File(mainpath); 
      if (!basePath.exists()) 
       Log.d("CAPTURE_BASE_PATH", basePath.mkdirs() ? "Success": "Failed"); 
      String path = mainpath + "photo_" + getPhotoTime() + ".jpg"; 
      File captureFile = new File(path); 
      captureFile.createNewFile(); 
      if (!captureFile.exists()) 
       Log.d("CAPTURE_FILE_PATH", captureFile.createNewFile() ? "Success": "Failed"); 
      FileOutputStream stream = new FileOutputStream(captureFile); 
      drawingCache.compress(Bitmap.CompressFormat.PNG, 100, stream); 
      stream.flush(); 
      stream.close(); 
     } catch (IOException e) { 
      e.printStackTrace(); 
     }

在這種情況下，我只得到什麼我畫在臉上：

mCameraSource.takePicture(shutterCallback, new CameraSource.PictureCallback() { 
      @Override 
      public void onPictureTaken(byte[] bytes) { 
       try { 
        String mainpath = getExternalStorageDirectory() + separator + "TestXyz" + separator + "images" + separator; 
        File basePath = new File(mainpath); 
        if (!basePath.exists()) 
         Log.d("CAPTURE_BASE_PATH", basePath.mkdirs() ? "Success": "Failed"); 
        String path = mainpath + "photo_" + getPhotoTime() + ".jpg"; 
        File captureFile = new File(path); 
        captureFile.createNewFile(); 
        if (!captureFile.exists()) 
         Log.d("CAPTURE_FILE_PATH", captureFile.createNewFile() ? "Success": "Failed"); 
        FileOutputStream stream = new FileOutputStream(captureFile); 
        stream.write(bytes); 
        stream.flush(); 
        stream.close(); 
       } catch (IOException e) { 
        e.printStackTrace(); 
       } 
      } 
     });

我也嘗試使用。這裏，mPreview是CameraSourcePreview。

只是加入捕獲按鈕，並在谷歌this例如上面的代碼中加入。

來源

2017-07-31 SANAT

請提供[MCVE]。 –

當然，讓我更新。 – SANAT

@代碼 - 學徒問題用代碼更新。 – SANAT

我能夠通過捕捉圖像與它繪製/油漆下面的解決方案：

private void captureImage() { 
     mPreview.setDrawingCacheEnabled(true); 
     Bitmap drawingCache = mPreview.getDrawingCache(); 

     mCameraSource.takePicture(shutterCallback, new CameraSource.PictureCallback() { 
      @Override 
      public void onPictureTaken(byte[] bytes) { 
       int orientation = Exif.getOrientation(bytes); 
       Bitmap temp = BitmapFactory.decodeByteArray(bytes, 0, bytes.length); 
       Bitmap picture = rotateImage(temp,orientation); 
       Bitmap overlay = Bitmap.createBitmap(mGraphicOverlay.getWidth(),mGraphicOverlay.getHeight(),picture.getConfig()); 
       Canvas canvas = new Canvas(overlay); 

       Matrix matrix = new Matrix(); 

       matrix.setScale((float)overlay.getWidth()/(float)picture.getWidth(),(float)overlay.getHeight()/(float)picture.getHeight()); 

       // mirror by inverting scale and translating 
       matrix.preScale(-1, 1); 
       matrix.postTranslate(canvas.getWidth(), 0); 

       Paint paint = new Paint(); 
       canvas.drawBitmap(picture,matrix,paint); 
       canvas.drawBitmap(drawingCache,0,0,paint); 

       try { 
        String mainpath = getExternalStorageDirectory() + separator + "MaskIt" + separator + "images" + separator; 
        File basePath = new File(mainpath); 
        if (!basePath.exists()) 
         Log.d("CAPTURE_BASE_PATH", basePath.mkdirs() ? "Success": "Failed"); 
        String path = mainpath + "photo_" + getPhotoTime() + ".jpg"; 
        File captureFile = new File(path); 
        captureFile.createNewFile(); 
        if (!captureFile.exists()) 
         Log.d("CAPTURE_FILE_PATH", captureFile.createNewFile() ? "Success": "Failed"); 
        FileOutputStream stream = new FileOutputStream(captureFile); 
        overlay.compress(Bitmap.CompressFormat.PNG, 100, stream); 
        stream.flush(); 
        stream.close(); 
        picture.recycle(); 
        drawingCache.recycle(); 
        mPreview.setDrawingCacheEnabled(false); 
       } catch (IOException e) { 
        e.printStackTrace(); 
       } 
      } 
     }); 
    }

有時取向問題也會發生在某些設備上。爲此，我使用了Exif類和rotateImage()函數。

的Exif類（從here參考）：

public class Exif { 
    private static final String TAG = "CameraExif"; 

    // Returns the degrees in clockwise. Values are 0, 90, 180, or 270. 
    public static int getOrientation(byte[] jpeg) { 
     if (jpeg == null) { 
      return 0; 
     } 

     int offset = 0; 
     int length = 0; 

     // ISO/IEC 10918-1:1993(E) 
     while (offset + 3 < jpeg.length && (jpeg[offset++] & 0xFF) == 0xFF) { 
      int marker = jpeg[offset] & 0xFF; 

      // Check if the marker is a padding. 
      if (marker == 0xFF) { 
       continue; 
      } 
      offset++; 

      // Check if the marker is SOI or TEM. 
      if (marker == 0xD8 || marker == 0x01) { 
       continue; 
      } 
      // Check if the marker is EOI or SOS. 
      if (marker == 0xD9 || marker == 0xDA) { 
       break; 
      } 

      // Get the length and check if it is reasonable. 
      length = pack(jpeg, offset, 2, false); 
      if (length < 2 || offset + length > jpeg.length) { 
       Log.e(TAG, "Invalid length"); 
       return 0; 
      } 

      // Break if the marker is EXIF in APP1. 
      if (marker == 0xE1 && length >= 8 && 
        pack(jpeg, offset + 2, 4, false) == 0x45786966 && 
        pack(jpeg, offset + 6, 2, false) == 0) { 
       offset += 8; 
       length -= 8; 
       break; 
      } 

      // Skip other markers. 
      offset += length; 
      length = 0; 
     } 

     // JEITA CP-3451 Exif Version 2.2 
     if (length > 8) { 
      // Identify the byte order. 
      int tag = pack(jpeg, offset, 4, false); 
      if (tag != 0x49492A00 && tag != 0x4D4D002A) { 
       Log.e(TAG, "Invalid byte order"); 
       return 0; 
      } 
      boolean littleEndian = (tag == 0x49492A00); 

      // Get the offset and check if it is reasonable. 
      int count = pack(jpeg, offset + 4, 4, littleEndian) + 2; 
      if (count < 10 || count > length) { 
       Log.e(TAG, "Invalid offset"); 
       return 0; 
      } 
      offset += count; 
      length -= count; 

      // Get the count and go through all the elements. 
      count = pack(jpeg, offset - 2, 2, littleEndian); 
      while (count-- > 0 && length >= 12) { 
       // Get the tag and check if it is orientation. 
       tag = pack(jpeg, offset, 2, littleEndian); 
       if (tag == 0x0112) { 
        // We do not really care about type and count, do we? 
        int orientation = pack(jpeg, offset + 8, 2, littleEndian); 
        switch (orientation) { 
         case 1: 
          return 0; 
         case 3: 
          return 3; 
         case 6: 
          return 6; 
         case 8: 
          return 8; 
        } 
        Log.i(TAG, "Unsupported orientation"); 
        return 0; 
       } 
       offset += 12; 
       length -= 12; 
      } 
     } 

     Log.i(TAG, "Orientation not found"); 
     return 0; 
    } 

    private static int pack(byte[] bytes, int offset, int length, 
      boolean littleEndian) { 
     int step = 1; 
     if (littleEndian) { 
      offset += length - 1; 
      step = -1; 
     } 

     int value = 0; 
     while (length-- > 0) { 
      value = (value << 8) | (bytes[offset] & 0xFF); 
      offset += step; 
     } 
     return value; 
    } 
}

rotateImage功能：

private Bitmap rotateImage(Bitmap bm, int i) { 
     Matrix matrix = new Matrix(); 
     switch (i) { 
      case ExifInterface.ORIENTATION_NORMAL: 
       return bm; 
      case ExifInterface.ORIENTATION_FLIP_HORIZONTAL: 
       matrix.setScale(-1, 1); 
       break; 
      case ExifInterface.ORIENTATION_ROTATE_180: 
       matrix.setRotate(180); 
       break; 
      case ExifInterface.ORIENTATION_FLIP_VERTICAL: 
       matrix.setRotate(180); 
       matrix.postScale(-1, 1); 
       break; 
      case ExifInterface.ORIENTATION_TRANSPOSE: 
       matrix.setRotate(90); 
       matrix.postScale(-1, 1); 
       break; 
      case ExifInterface.ORIENTATION_ROTATE_90: 
       matrix.setRotate(90); 
       break; 
      case ExifInterface.ORIENTATION_TRANSVERSE: 
       matrix.setRotate(-90); 
       matrix.postScale(-1, 1); 
       break; 
      case ExifInterface.ORIENTATION_ROTATE_270: 
       matrix.setRotate(-90); 
       break; 
      default: 
       return bm; 
     } 
     try { 
      Bitmap bmRotated = Bitmap.createBitmap(bm, 0, 0, bm.getWidth(), bm.getHeight(), matrix, true); 
      bm.recycle(); 
      return bmRotated; 
     } catch (OutOfMemoryError e) { 
      e.printStackTrace(); 
      return null; 
     } 
    }

來源

2017-08-08 08:27:39 SANAT

你可以實現你想要把它分成更小的步驟的效果。

拍攝照片
發送位圖到谷歌手機視覺檢測臉上的「地標」，並且每隻眼睛是開放
塗料適當的「眼睛」在圖像上的概率

使用Google Mobile Vision的FaceDetector時，您將返回一個SparseArray的Face對象（可能包含多個面或可能爲空）。所以你需要處理這些情況。但是你可以遍歷SparseArray並找到你想要玩的Face對象。

static Bitmap processFaces(Context context, Bitmap picture) { 
    // Create a "face detector" object, using the builder pattern 
    FaceDetector detector = new FaceDetector.Builder(context) 
      .setTrackingEnabled(false) // disable tracking to improve performance 
      .setClassificationType(FaceDetector.ALL_CLASSIFICATIONS) 
      .build(); 

    // create a "Frame" object, again using a builder pattern (and passing in our picture) 
    Frame frame = new Frame.Builder().setBitmap(picture).build(); // build frame 

    // get a sparse array of face objects 
    SparseArray<Face> faces = detector.detect(frame); // detect the faces 

    // This example just deals with a single face for the sake of simplicity, 
    // but you can change this to deal with multiple faces. 
    if (faces.size() != 1) return picture; 

    // make a mutable copy of the background image that we can modify 
    Bitmap bmOverlay = Bitmap.createBitmap(picture.getWidth(), picture.getHeight(), picture.getConfig()); 
    Canvas canvas = new Canvas(bmOverlay); 
    canvas.drawBitmap(picture, 0, 0, null); 
    // get the Face object that we want to manipulate, and process it 
    Face face = faces.valueAt(0); 
    processFace(face, canvas); 
    detector.release(); 
    return bmOverlay; 
}

一旦你得到了一個Face對象，你可以找到的功能，你的興趣像這樣

private static void processFace(Face face, Canvas canvas) { 
    // The Face object can tell you the probability that each eye is open. 
    // I'm comparing this probability to an arbitrary threshold of 0.6 here, 
    // but you can vary it between 0 and 1 as you please. 
    boolean leftEyeClosed = face.getIsLeftEyeOpenProbability() < .6; 
    boolean rightEyeClosed = face.getIsRightEyeOpenProbability() < .6; 
    // Loop through the face's "landmarks" (eyes, nose, etc) to find the eyes. 
    // landmark.getPosition() gives you the (x,y) coordinates of each feature. 
    for (Landmark landmark : face.getLandmarks()) { 
     if (landmark.getType() == Landmark.LEFT_EYE) 
      overlayEyeBitmap(canvas, leftEyeClosed, landmark.getPosition().x, landmark.getPosition().y); 
     if (landmark.getType() == Landmark.RIGHT_EYE) 
      overlayEyeBitmap(canvas, rightEyeClosed, landmark.getPosition().x, landmark.getPosition().y); 
    } 
}

然後，您可以將您的油漆！

private static void overlayEyeBitmap(Canvas canvas, boolean eyeClosed, float cx, float cy) { 
    float radius = 40; 

    // draw the eye's background circle with appropriate color 
    Paint paintFill = new Paint(); 
    paintFill.setStyle(Paint.Style.FILL); 
    if (eyeClosed) 
     paintFill.setColor(Color.YELLOW); 
    else 
     paintFill.setColor(Color.WHITE); 
    canvas.drawCircle(cx, cy, radius, paintFill); 

    // draw a black border around the eye 
    Paint paintStroke = new Paint(); 
    paintStroke.setColor(Color.BLACK); 
    paintStroke.setStyle(Paint.Style.STROKE); 
    paintStroke.setStrokeWidth(5); 
    canvas.drawCircle(cx, cy, radius, paintStroke); 

    if (eyeClosed) 
     // draw horizontal line across closed eye 
     canvas.drawLine(cx - radius, cy, cx + radius, cy, paintStroke); 
    else { 
     // draw big off-center pupil on open eye 
     paintFill.setColor(Color.BLACK); 
     float cxPupil = cx - 10; 
     float cyPupil = cy + 10; 
     canvas.drawCircle(cxPupil, cyPupil, 25, paintFill); 
    } 
}

在片段上方，我只是硬編碼眼半徑，以示概念驗證。您可能需要做一些更加靈活縮放，使用face.getWidth()一定百分比來確定合適的值。但這裏是該圖像處理可以這樣做：

關於移動視覺API一些更細節here和Udacity's current Advanced Android course有這個東西一個很好的演練（拍照，將其發送到移動願景，並在它上面添加一個位圖）。該課程是免費的，或者你可以看看他們做了什麼on Github。

來源

2017-08-03 23:53:38

我可以用油漆捕捉圖像嗎？我需要在相機圖像上使用油漆圖像。 – SANAT

不知道你到底在問什麼。您可以使用相機意圖捕捉純色圖像。正如我所描述的，您可以將繪製圖像合併到該圖像你可以保存一個圖像，像我包含在一個文件中的圖像，或者共享它，或者在你自己的指紋活動中用作背景，或者其他任何東西。 –

我只想保存在我的問題中的圖像。相機圖像+可繪製/繪製它。 – SANAT

你很接近實現你所需要的:)

您有：

從臉的攝像頭（第一個代碼段）
從畫布圖像的圖像眼睛覆蓋（第二代碼片段）

你需要什麼：

將臉部與眼睛重疊在一起的圖像 - 合併的圖像。

如何合併？

要合併2個圖像簡單地用帆布，就像這樣：

public Bitmap mergeBitmaps(Bitmap face, Bitmap overlay) { 
    // Create a new image with target size 
    int width = face.getWidth(); 
    int height = face.getHeight(); 
    Bitmap newBitmap = Bitmap.createBitmap(width, height, Bitmap.Config.ARGB_8888); 

    Rect faceRect = new Rect(0,0,width,height); 
    Rect overlayRect = new Rect(0,0,overlay.getWidth(),overlay.getHeight()); 

    // Draw face and then overlay (Make sure rects are as needed) 
    Canvas canvas = new Canvas(newBitmap); 
    canvas.drawBitmap(face, faceRect, faceRect, null); 
    canvas.drawBitmap(overlay, overlayRect, faceRect, null); 
    return newBitmap 
}

然後你就可以保存新的形象，因爲你現在做的事情。

全部代碼是這樣：

mCameraSource.takePicture(shutterCallback, new 
CameraSource.PictureCallback() { 
     @Override 
     public void onPictureTaken(byte[] bytes) { 
      // Generate the Face Bitmap 
      BitmapFactory.Options options = new BitmapFactory.Options(); 
      Bitmap face = BitmapFactory.decodeByteArray(bytes, 0, bytes.length, options); 

      // Generate the Eyes Overlay Bitmap 
      mPreview.setDrawingCacheEnabled(true); 
      Bitmap overlay = mPreview.getDrawingCache(); 

      // Generate the final merged image 
      Bitmap result = mergeBitmaps(face, overlay); 

      // Save result image to file 
      try { 
       String mainpath = getExternalStorageDirectory() + separator + "TestXyz" + separator + "images" + separator; 
       File basePath = new File(mainpath); 
       if (!basePath.exists()) 
        Log.d("CAPTURE_BASE_PATH", basePath.mkdirs() ? "Success": "Failed"); 
       String path = mainpath + "photo_" + getPhotoTime() + ".jpg"; 
       File captureFile = new File(path); 
       captureFile.createNewFile(); 
       if (!captureFile.exists()) 
        Log.d("CAPTURE_FILE_PATH", captureFile.createNewFile() ? "Success": "Failed"); 
       FileOutputStream stream = new FileOutputStream(captureFile); 
       result.compress(Bitmap.CompressFormat.PNG, 100, stream); 
       stream.flush(); 
       stream.close(); 
      } catch (IOException e) { 
       e.printStackTrace(); 
      } 
     } 
    });

注意的是，以上只是一個例子代碼。您應該將合併和保存到文件移動到後臺線程。

來源

2017-08-06 08:59:07

感謝您的回答。我已經嘗試過你在這裏提到的，並且我的代碼也取得了成功。讓我發表我的答案。它也會幫助其他人。 – SANAT

以使用視覺API

回答

相關問題