IssueTracker

The DataprocFileOutputCommitter feature is an enhanced version of the open source FileOutputCommitter, enables concurrent writes by Spark jobs to an output location which is a limitation of Open Source Apache Spark.

However, this limitation still exists for Parquet write. The parquet write is handled by ParquetOutputCommitter, NOT DataprocFileOutputCommitter. The concurrent write support should be extended to Parquet Committer to solve the issue for customers when writing parquet data from spark jobs.