Build #1,399

Build: #1399 was successful Child of CDAP-DRC-5385

Build result summary

Details

Completed
Duration
13 minutes
Labels
None
Agent
bamboo-agent17
Revision
7c604765f33445e9e07954692ed87a02cbdd0cb0 7c604765f33445e9e07954692ed87a02cbdd0cb0
Successful since
#1263 ()

Code commits

Author Commit Message Commit date
Fernando Velasquez Fernando Velasquez 7c604765f33445e9e07954692ed87a02cbdd0cb0 7c604765f33445e9e07954692ed87a02cbdd0cb0 Merge pull request #13343 from cdapio/CDAP-17864-implement-full-sql-engine-integration
Tie SQL Engine integration into Spark Pipeline Runner and RDD Collection.
Fernando Velasquez Fernando Velasquez 91e0dd9ddd4f43bfafd14c504873a81dbc823a73 m 91e0dd9ddd4f43bfafd14c504873a81dbc823a73 Tie SQL Engine integration into Spark Pipeline Runner and RDD Collection.
Added support for stage metrics for SQL engine jobs.

Added unit test for Joins using the SQL engine.

Implemented new SQLEngineCollection class to represent records residing in the SQL engine. This class will pull and delegate to the RDDCOllection as needed.

Added note detailing that SQL join operations can only be performed after all involved datasets have been pushed to the SQL engine beforehand.

Added test for logic that decides wether we should push to the SQL engine or not.