albertshau <ashau@google.com>: Author Summary

Builds triggered by albertshau <ashau@google.com>

Builds triggered by an author are those builds which contains changes committed by the author.
712
188 (26%)
524 (74%)

Breakages and fixes

Broken means the build has failed but the previous build was successful.
Fixed means that the build was successful but the previous build has failed.
56 (8% of all builds triggered)
57 (8% of all builds triggered)
1
Build Completed Code commits Tests
IT › ITCC › #33 3 weeks ago
Merge pull request #1003 from aielchiieva/CDAP-14895
CDAP-14895: Add ARRAY and complex UNION types support to Google Cloud Datastore integration tests
Merge pull request #999 from aielchiieva/CDAP-14740
CDAP-14740: Google Cloud Datastore integration tests
1 of 1 failed
CDAP › DUT › #2552 1 month ago
check program state messages in test
CDAP-15047 improve bootstrap steps
Fixed a bug in the program starter where provisioning steps were
being skipped.

Added a log message when the program starter doesn't due anything
because the program is not stopped.

Enhanced the system artifacts loader so that system artifacts
are loaded in parallel. This speeds up bootstrap quite a bit
in environments where the filesystem is slower.
CDAP-15048 write program state transitions in k8s runner
2481 passed
CDAP › RUT › #758 1 month ago
CDAP-15047 improve bootstrap steps
Fixed a bug in the program starter where provisioning steps were
being skipped.

Added a log message when the program starter doesn't due anything
because the program is not stopped.

Enhanced the system artifacts loader so that system artifacts
are loaded in parallel. This speeds up bootstrap quite a bit
in environments where the filesystem is slower.
CDAP-15048 write program state transitions in k8s runner
check program state messages in test
2481 passed
CDAP › UDUT › #484 1 month ago
check program state messages in test
CDAP-15047 improve bootstrap steps
Fixed a bug in the program starter where provisioning steps were
being skipped.

Added a log message when the program starter doesn't due anything
because the program is not stopped.

Enhanced the system artifacts loader so that system artifacts
are loaded in parallel. This speeds up bootstrap quite a bit
in environments where the filesystem is slower.
CDAP-15048 write program state transitions in k8s runner
Testless build
CDAP › URUT › #486 1 month ago
CDAP-15047 improve bootstrap steps
Fixed a bug in the program starter where provisioning steps were
being skipped.

Added a log message when the program starter doesn't due anything
because the program is not stopped.

Enhanced the system artifacts loader so that system artifacts
are loaded in parallel. This speeds up bootstrap quite a bit
in environments where the filesystem is slower.
CDAP-15048 write program state transitions in k8s runner
check program state messages in test
Testless build
CDAP › DRC › #4405 1 month ago
check program state messages in test
CDAP-15047 improve bootstrap steps
Fixed a bug in the program starter where provisioning steps were
being skipped.

Added a log message when the program starter doesn't due anything
because the program is not stopped.

Enhanced the system artifacts loader so that system artifacts
are loaded in parallel. This speeds up bootstrap quite a bit
in environments where the filesystem is slower.
CDAP-15048 write program state transitions in k8s runner
Testless build
CDAP › DUT › #2542 1 month ago
CDAP-15037 fix user scoped plugin loading in service
Added a way to get a dynamic plugin configurer for a different
namespace than the one a service is running in. Used this
capability to fix a bug in the pipeline studio service where
only system scoped plugins were able to be loaded.
Merge pull request #11131 from cdapio/feature/CDAP-14905-k8s-twill-runner
CDAP-14905 add a kubernetes twill runner
CDAP-14905 add a kubernetes twill runner
Add a kubernetes implementation of TwillRunner to support running
programs on Kubernetes instead of YARN.
The runner currently only supports service program types.

It works by creating a config-map that contains the serialized
app spec and program options. It then creates a deployment for
the actual service program, with the config-map mounted as a
volume and arguments that point to the app spec and options.
The deployment and config-map are both run specific, and are
cleaned up when the program stops.
Merge pull request #11174 from cdapio/feature/CDAP-15037-fix-user-plugin-loading
CDAP-15037 fix user scoped plugin loading in service
1 of 1792 failed
HYP › BAD › #228 1 month ago
Null check for query before getting schema
Merge pull request #894 from cdapio/feature/fix-db-tests
Null check for query before getting schema
2 of 238 failed
CDAP › RUT › #749 1 month ago
CDAP-14905 add a kubernetes twill runner
Add a kubernetes implementation of TwillRunner to support running
programs on Kubernetes instead of YARN.
The runner currently only supports service program types.

It works by creating a config-map that contains the serialized
app spec and program options. It then creates a deployment for
the actual service program, with the config-map mounted as a
volume and arguments that point to the app spec and options.
The deployment and config-map are both run specific, and are
cleaned up when the program stops.
Merge pull request #11131 from cdapio/feature/CDAP-14905-k8s-twill-runner
CDAP-14905 add a kubernetes twill runner
2481 passed
CDAP › URUT › #470 1 month ago
Merge pull request #11131 from cdapio/feature/CDAP-14905-k8s-twill-runner
CDAP-14905 add a kubernetes twill runner
CDAP-14905 add a kubernetes twill runner
Add a kubernetes implementation of TwillRunner to support running
programs on Kubernetes instead of YARN.
The runner currently only supports service program types.

It works by creating a config-map that contains the serialized
app spec and program options. It then creates a deployment for
the actual service program, with the config-map mounted as a
volume and arguments that point to the app spec and options.
The deployment and config-map are both run specific, and are
cleaned up when the program stops.
Testless build
Build Completed Code commits Tests
IT › ITCC › #33 3 weeks ago
Merge pull request #1003 from aielchiieva/CDAP-14895
CDAP-14895: Add ARRAY and complex UNION types support to Google Cloud Datastore integration tests
Merge pull request #999 from aielchiieva/CDAP-14740
CDAP-14740: Google Cloud Datastore integration tests
1 of 1 failed
HYP › BAD › #227 1 month ago
Merge pull request #893 from cdapio/feature/CDAP-14772-remove-plugin-endpoint
CDAP-14772 remove plugin endpoint from db source
CDAP-14772 remove plugin endpoint from db source
Instead, the source will lookup the schema if the schema is null,
and has the UI configured to always send a null schema when using
the get schema button.
7 of 218 failed
CDAP › RUT › #747 1 month ago
Merge pull request #11166 from cdapio/feature/CDAP-13326-consolidate-pipeline-prepare
CDAP-13326 consolidate prepare logic into a common class
CDAP-13326 consolidate prepare logic into a common class
Consolidate the common code in ETLMapReduce and ETLSpark.

This basically amounts to moving code that was common to both
into a new PipelinePhasePreparer and moving MR specific logic into
MapReducePreparer and Spark specific logic into SparkPreparer.
1 of 1792 failed
CDAP › DUT › #2541 1 month ago
CDAP-13326 consolidate prepare logic into a common class
Consolidate the common code in ETLMapReduce and ETLSpark.

This basically amounts to moving code that was common to both
into a new PipelinePhasePreparer and moving MR specific logic into
MapReducePreparer and Spark specific logic into SparkPreparer.
Merge pull request #11166 from cdapio/feature/CDAP-13326-consolidate-pipeline-prepare
CDAP-13326 consolidate prepare logic into a common class
414 passed
CDAP › DUT › #2529 1 month ago
Merge pull request #11155 from mlozbin-cybervisiontech/feature/CDAP-13558-keep_message_order_in_mocksink
CDAP-13558 Support CDC pipelines on Spark version 2.x
1 of 2450 failed
CDAP › DUT › #2524 1 month ago
Merge pull request #11141 from cdapio/feature/CDAP-14998-fix-memory-leak
CDAP-14998 fix DatasetRuntimeContext leak
CDAP-14998 fix DatasetRuntimeContext leak
Fixed a memory leak caused by the DefaultDatasetRuntimeContext.
The context uses a ThreadLocal variable, which means every time
an instance is created, another ThreadLocal instance gets added
to the Thread's local map. These variables were never getting
removed, which means long running threads would continually
accumulate these variables until running out of memory.

Made the DatasetRuntimeContext implement Closeable and made sure
datasets always close the runtime context when the dataset is
closed. The DefaultDataRuntimeContext then removes the thread
local variable in its close method, preventing the leak.
1 of 2133 failed
CDAP › DUT › #2511 1 month ago
bind preview to localhost in unit test
Merge pull request #11116 from cdapio/feature/CDAP-14954-preview-main
CDAP-14954 create PreviewServiceMain for preview in kubernetes
CDAP-14954 create PreviewServiceMain for preview in kubernetes
Created a PreviewServiceMain that is very similar to AppFabricMain
except it uses standalone program runners instead of the distributed
ones. Created a PreviewHttpServer that runs the PreviewHttpHandler
instead of having AppFabricServer run it.

Distributed CDAP will temporarily not support preview until it is
added back as a master service.
1 of 2445 failed
CDAP › URUT › #414 1 month ago
CDAP-14905 default dataset executor bind address
Set a default for the dataset executor bind address to 0.0.0.0,
which is the same default as all the other system services.

Without a default value, netty-http will bind it to localhost,
which will not be accessible through kubernetes services.
Merge pull request #11101 from cdapio/feature/CDAP-14905-default-dataset-executor-host
CDAP-14905 default dataset executor bind address
Testless build
IT › CLD › #202 2 months ago
Merge pull request #1000 from cdapio/feature/CDAP-14908-remove-app-version-test
CDAP-14908 remove app version test since CDAP no longer supports it
CDAP-14908 remove app version test since CDAP no longer supports it
Testless build
IT › ITCC › #30 2 months ago
CDAP-14908 remove app version test since CDAP no longer supports it
Merge pull request #1000 from cdapio/feature/CDAP-14908-remove-app-version-test
CDAP-14908 remove app version test since CDAP no longer supports it
2 of 3 failed
Build Completed Code commits Tests
CDAP › RUT › #748 1 month ago
CDAP-15037 fix user scoped plugin loading in service
Added a way to get a dynamic plugin configurer for a different
namespace than the one a service is running in. Used this
capability to fix a bug in the pipeline studio service where
only system scoped plugins were able to be loaded.
Merge pull request #11174 from cdapio/feature/CDAP-15037-fix-user-plugin-loading
CDAP-15037 fix user scoped plugin loading in service
2481 passed
CDAP › DRC › #4330 1 month ago
Merge pull request #11111 from cdapio/fix-compilation
fix compilation
fix compilation
Testless build
IT › ITCC › #32 2 months ago
Merge pull request #1001 from cdapio/fix-wrangler-tests
fix wrangler pipeline test
fix wrangler pipeline test
The wrangler pipeline test does not require the wrangler
service to be running, so removed the part that deploys and starts
the service. This was failing due to the fact that wrangler must
now be deployed to the system namespace.

Also fixed a compilation issue due to a class being moved.
2 passed
CDAP › DUT › #2492 2 months ago
CDAP-14915 fix flaky program lifecycle test
Fixed the test to wait for the cluster status to be deprovisioned,
since the update happens asynchronously.
Merge pull request #11069 from cdapio/feature/CDAP-14915-fix-flaky-test
CDAP-14915 fix flaky program lifecycle test
2407 passed
IT › CLD › #203 2 months ago
fix wrangler pipeline test
The wrangler pipeline test does not require the wrangler
service to be running, so removed the part that deploys and starts
the service. This was failing due to the fact that wrangler must
now be deployed to the system namespace.

Also fixed a compilation issue due to a class being moved.
Merge pull request #1001 from cdapio/fix-wrangler-tests
fix wrangler pipeline test
2 passed
IT › ITC › #339 2 months ago
fix wrangler pipeline test
The wrangler pipeline test does not require the wrangler
service to be running, so removed the part that deploys and starts
the service. This was failing due to the fact that wrangler must
now be deployed to the system namespace.

Also fixed a compilation issue due to a class being moved.
Merge pull request #1001 from cdapio/fix-wrangler-tests
fix wrangler pipeline test
46 passed
CDAP › DUT › #2485 2 months ago
Merge pull request #11056 from cdapio/feature/CDAP-14916-fix-tx-runners-exception-propagation
CDAP-14916 fix TransactionRunners runtime exception propagation
CDAP-14916 fix TransactionRunners runtime exception propagation
Fixed a bug with the TransactionRunners.run() methods that take a
single runnable and no exception classes. These methods used to
throw a RuntimeException around the TransactionException around
the actual RuntimeException thrown by the TxRunnable.
2399 passed
IT › IIT › #278 2 months ago
fix wrangler pipeline test
The wrangler pipeline test does not require the wrangler
service to be running, so removed the part that deploys and starts
the service. This was failing due to the fact that wrangler must
now be deployed to the system namespace.

Also fixed a compilation issue due to a class being moved.
Merge pull request #1001 from cdapio/fix-wrangler-tests
fix wrangler pipeline test
47 passed
IT › ITM › #79 2 months ago
Merge pull request #1001 from cdapio/fix-wrangler-tests
fix wrangler pipeline test
fix wrangler pipeline test
The wrangler pipeline test does not require the wrangler
service to be running, so removed the part that deploys and starts
the service. This was failing due to the fact that wrangler must
now be deployed to the system namespace.

Also fixed a compilation issue due to a class being moved.
46 passed
HYP › BAD › #221 2 months ago
Merge pull request #886 from cdapio/fix-rat-check
add missing copyright from test classes
add missing copyright from test classes
663 passed