IssueTracker

CAMERAX VERSION: 1.2.2, 1.2.3, 1.3.0

CAMERA APPLICATION NAME AND VERSION: Elevien, 3.63.1

ANDROID OS BUILD NUMBER: UP1A.231105.003

DEVICE NAME: Pixel 6

DESCRIPTION: On Pixel 6, we noticed that when audio recording is enabled, the first (or couple) of frames of the video are black. When disabling audio recording (removing .withAudio()), the video is fine, without black frames. We were able to track it a bit back and came to a conclusion that it's happening from CameraX version 1.2.2, but also we were also able to track back to Android 13 on Pixel 6 as we see there are some videos with black frames from that time as well. Unfortunately we're unable to pin point the exact time when that started happening. We are taking video poster images from first frame of the video to preload as a image placeholder while the video loads in the app, so this results in black poster images.

My CameraX SDK setup is rather simple, with only setting the cameraSelector to DEFAULT_BACK_CAMERA, QualitySelector and output target rotation set to ROTATION_90. Recording config is set-up with .withAudioEnabled(), as we want to enable audio recording, but that causes the issue. See code fragments at the end.

STEPS TO REPRODUCE:

1. Just start the recording with the given configs on Pixel 6
2. Finish recording
3. Check out the video, the first (or couple) of frames is black

OBSERVED RESULTS: When recording video with audio recording enabled, first (or couple) of frames are black. When recording without audio recording enabled, video is fine and doesn't start with black frames.

EXPECTED RESULTS: Video doesn't start with black frames when audio recording is enabled.

REPRODUCIBILITY: 5 of 5

ADDITIONAL INFORMATION: As far as we could test this behaviour, it doesn't happen on every device. For example, Pixel 7 is recording these videos just fine (no black frames at the begining of the video).

CODE FRAGMENTS:

        val cameraSelector = CameraSelector.DEFAULT_BACK_CAMERA

        // oreview configuration
        val preview = Preview.Builder()
            .setCameraSelector(cameraSelector)
            .build()
            .also { it.setSurfaceProvider(binding.viewFinder.surfaceProvider) }

        // video capture configuration
        val recorder = Recorder.Builder()
            .setQualitySelector(
                QualitySelector.fromOrderedList(
                    listOf(Quality.FHD, Quality.HD, Quality.SD),
                    FallbackStrategy.lowerQualityOrHigherThan(Quality.HD)
                )
            ).build()

        videoCapture = VideoCapture.withOutput(recorder).apply { targetRotation = Surface.ROTATION_90 }

As for the Recording setup, I'm using MediaStoreOutput provider and I'm enabling the audio recording.

     // recording setup
 val mediaStoreOutput = MediaStoreOutputOptions.Builder(
        requireContext().contentResolver,
        MediaStore.Video.Media.EXTERNAL_CONTENT_URI
    ).setContentValues(contentValues).build()

  val recording = videoCapture.output
            .prepareRecording(requireActivity(), mediaStoreOutput)
            .withAudioEnabled()
            .start(mainThreadExecutor) {...}