Build #109

Build: #109 failed Scheduled with changes by Ali Anwar and mattwuenschel <mwuenschel@google.com>

Stages & jobs

  1. Variables

  2. Spinup and Test

Build result summary

Details

Completed
Duration
199 minutes
Labels
None
Revisions
CDAP Integration Tests
9580b139502158ebf667990e3374e2cf19faf278 9580b139502158ebf667990e3374e2cf19faf278
Coopr-internal
aeafcc25ed6b87d5687d19cbb62cf7f61f4e72b6 aeafcc25ed6b87d5687d19cbb62cf7f61f4e72b6
Total tests
62
Failing since
#60 (Scheduled – )
Fixed in
#153 (Manual run by Matt Wuenschel)

Responsible

This build has been failing since #60
No one has taken responsibility

Code commits

CDAP Integration Tests
Author Commit Message Commit date
Ali Anwar Ali Anwar 9580b139502158ebf667990e3374e2cf19faf278 9580b139502158ebf667990e3374e2cf19faf278 Merge pull request #912 from caskdata/bump-dataset-executor-memory
Bump dataset executor memory on HDP 2.6.
Ali Anwar Ali Anwar 25c72c30275f323a3646810be3d0a0698c22206b 25c72c30275f323a3646810be3d0a0698c22206b Bump dataset executor memory on HDP 2.6.
Bump dataset executor memory on HDP 2.6. I'm limiting this change to HDP 2.6, since other distros don't seem to be having their dataset executors being killed for going over the configured memory of 512mb.
We can investigate further if there is something unique to HDP 2.6 that is causing this issue.
Coopr-internal
Author Commit Message Commit date
mattwuenschel <mwuenschel@google.com> mattwuenschel <mwuenschel@google.com> aeafcc25ed6b87d5687d19cbb62cf7f61f4e72b6 aeafcc25ed6b87d5687d19cbb62cf7f61f4e72b6 Merge pull request #687 from caskdata/feature/coopr-gbase-falcon
add falcon installer
mattwuenschel <mwuenschel@google.com> mattwuenschel <mwuenschel@google.com> e1075c44fe18a8f2dc49522ab58d7f2cba866664 m e1075c44fe18a8f2dc49522ab58d7f2cba866664 update platform version
mattwuenschel <mwuenschel@google.com> mattwuenschel <mwuenschel@google.com> b83be37bd35fc55c63db46b876650474a18882cf m b83be37bd35fc55c63db46b876650474a18882cf install lib-genl-3-200 package

Configuration changes

Plan configuration has changed since the last successful build. See the plan audit log for more details.

Tests

Existing test failures 49
Status Test Failing since View job Duration
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/kvtable1/versions/-SNAPSHOT/services/DatasetService/methods/read HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.doPost(RemoteKeyValueTable.java:170)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.doPost(RemoteKeyValueTable.java:163)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.read(RemoteKeyValueTable.java:77)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.read(RemoteKeyValueTable.java:70)
	at co.cask.cdap.app.etl.KVTableWithProjectionTest.testKVTableWithProjection(KVTableWithProjectionTest.java:85)
java.io.IOException: 500: Connection refused: it-itc-cm512-109-31983-1004.dev.continuuity.net/10.210.0.8:36550
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:74)
	at co.cask.cdap.app.etl.StreamTPFSWithProjectionTest.verifyTPFSData(StreamTPFSWithProjectionTest.java:115)
	at co.cask.cdap.app.etl.StreamTPFSWithProjectionTest.testStreamTPFSWithProjection(StreamTPFSWithProjectionTest.java:104)
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/purchaseSource/versions/-SNAPSHOT/services/DatasetService/methods/put HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.table.RemoteTable.doPost(RemoteTable.java:139)
	at co.cask.cdap.remote.dataset.table.RemoteTable.put(RemoteTable.java:89)
	at co.cask.cdap.data2.dataset2.lib.table.AbstractTable.put(AbstractTable.java:124)
	at co.cask.cdap.app.etl.batch.BatchAggregatorTest.putValues(BatchAggregatorTest.java:260)
	at co.cask.cdap.app.etl.batch.BatchAggregatorTest.ingestData(BatchAggregatorTest.java:245)
(1 more lines...)
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/inputTable/versions/-SNAPSHOT/services/DatasetService/methods/put HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.table.RemoteTable.doPost(RemoteTable.java:139)
	at co.cask.cdap.remote.dataset.table.RemoteTable.put(RemoteTable.java:89)
	at co.cask.cdap.data2.dataset2.lib.table.AbstractTable.put(AbstractTable.java:124)
	at co.cask.cdap.app.etl.batch.BatchCubeSinkTest.test(BatchCubeSinkTest.java:101)
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/film-joinertest/versions/-SNAPSHOT/services/DatasetService/methods/put HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.table.RemoteTable.doPost(RemoteTable.java:139)
	at co.cask.cdap.remote.dataset.table.RemoteTable.put(RemoteTable.java:89)
	at co.cask.cdap.data2.dataset2.lib.table.AbstractTable.put(AbstractTable.java:124)
	at co.cask.cdap.app.etl.batch.BatchJoinerTest.putFilm(BatchJoinerTest.java:374)
	at co.cask.cdap.app.etl.batch.BatchJoinerTest.ingestToFilmTable(BatchJoinerTest.java:362)
(2 more lines...)
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/film-joinertest/versions/-SNAPSHOT/services/DatasetService/methods/put HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.table.RemoteTable.doPost(RemoteTable.java:139)
	at co.cask.cdap.remote.dataset.table.RemoteTable.put(RemoteTable.java:89)
	at co.cask.cdap.data2.dataset2.lib.table.AbstractTable.put(AbstractTable.java:124)
	at co.cask.cdap.app.etl.batch.BatchJoinerTest.putFilm(BatchJoinerTest.java:374)
	at co.cask.cdap.app.etl.batch.BatchJoinerTest.ingestToFilmTable(BatchJoinerTest.java:362)
(2 more lines...)
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/inputTable/versions/-SNAPSHOT/services/DatasetService/methods/put HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.table.RemoteTable.doPost(RemoteTable.java:139)
	at co.cask.cdap.remote.dataset.table.RemoteTable.put(RemoteTable.java:89)
	at co.cask.cdap.data2.dataset2.lib.table.AbstractTable.put(AbstractTable.java:124)
	at co.cask.cdap.app.etl.batch.ETLMapReduceTest.testTableToTableWithValidations(ETLMapReduceTest.java:606)
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/table1/versions/-SNAPSHOT/services/DatasetService/methods/write HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.doPost(RemoteKeyValueTable.java:170)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.write(RemoteKeyValueTable.java:96)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.write(RemoteKeyValueTable.java:101)
	at co.cask.cdap.app.etl.batch.ETLMapReduceTest.testKVToKV(ETLMapReduceTest.java:102)
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/input/versions/-SNAPSHOT/services/DatasetService/methods/put HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.table.RemoteTable.doPost(RemoteTable.java:139)
	at co.cask.cdap.remote.dataset.table.RemoteTable.put(RemoteTable.java:89)
	at co.cask.cdap.data2.dataset2.lib.table.AbstractTable.put(AbstractTable.java:124)
	at co.cask.cdap.app.etl.batch.ETLMapReduceTest.ingestPurchaseTestData(ETLMapReduceTest.java:703)
	at co.cask.cdap.app.etl.batch.ETLMapReduceTest.testDAGSchemaChanges(ETLMapReduceTest.java:444)
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/input/versions/-SNAPSHOT/services/DatasetService/methods/put HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.table.RemoteTable.doPost(RemoteTable.java:139)
	at co.cask.cdap.remote.dataset.table.RemoteTable.put(RemoteTable.java:89)
	at co.cask.cdap.data2.dataset2.lib.table.AbstractTable.put(AbstractTable.java:124)
	at co.cask.cdap.app.etl.batch.ETLMapReduceTest.ingestPurchaseTestData(ETLMapReduceTest.java:703)
	at co.cask.cdap.app.etl.batch.ETLMapReduceTest.testDAG(ETLMapReduceTest.java:191)
java.io.IOException: 409: Dataset 'excelreader' already exists
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:74)
	at co.cask.cdap.app.etl.batch.ExcelInputReaderTest.testSetup(ExcelInputReaderTest.java:74)
java.lang.RuntimeException: java.util.concurrent.TimeoutException: Timeout occurred. Expected true but found false.
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:70)
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:91)
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:130)
	at co.cask.cdap.test.remote.RemoteServiceManager.getServiceURL(RemoteServiceManager.java:86)
	at co.cask.cdap.app.etl.batch.ExcelInputReaderTest.testSetup(ExcelInputReaderTest.java:70)
java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/FileSetExample/versions/-SNAPSHOT/services/FileSetService/methods/inputDataset/create HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:69)
	at co.cask.cdap.app.etl.batch.HivePluginTest.testHivePlugins(HivePluginTest.java:95)
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/customerPurchaseWithEmptyTable/versions/-SNAPSHOT/services/DatasetService/methods/put HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.table.RemoteTable.doPost(RemoteTable.java:139)
	at co.cask.cdap.remote.dataset.table.RemoteTable.put(RemoteTable.java:89)
	at co.cask.cdap.data2.dataset2.lib.table.AbstractTable.put(AbstractTable.java:124)
	at co.cask.cdap.app.etl.batch.NormalizeTest.putData(NormalizeTest.java:137)
	at co.cask.cdap.app.etl.batch.NormalizeTest.testNormalizeWithEmptyAttributeValue(NormalizeTest.java:209)
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/customerPurchaseTable/versions/-SNAPSHOT/services/DatasetService/methods/put HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.table.RemoteTable.doPost(RemoteTable.java:139)
	at co.cask.cdap.remote.dataset.table.RemoteTable.put(RemoteTable.java:89)
	at co.cask.cdap.data2.dataset2.lib.table.AbstractTable.put(AbstractTable.java:124)
	at co.cask.cdap.app.etl.batch.NormalizeTest.putData(NormalizeTest.java:137)
	at co.cask.cdap.app.etl.batch.NormalizeTest.testNormalize(NormalizeTest.java:156)
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/denormalizerSource/versions/-SNAPSHOT/services/DatasetService/methods/put HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.table.RemoteTable.doPost(RemoteTable.java:139)
	at co.cask.cdap.remote.dataset.table.RemoteTable.put(RemoteTable.java:89)
	at co.cask.cdap.data2.dataset2.lib.table.AbstractTable.put(AbstractTable.java:124)
	at co.cask.cdap.app.etl.batch.RowDenormalizerTest.putValues(RowDenormalizerTest.java:138)
	at co.cask.cdap.app.etl.batch.RowDenormalizerTest.ingestInputData(RowDenormalizerTest.java:122)
(1 more lines...)
java.io.IOException: 503: No discoverable found for request GET /v3/namespaces/itncm/apps/DatasetAccessApp/versions/-SNAPSHOT/services/TPFSService/methods/tpfs/tpfs1?startTime=1528806196763&endTime=1528806796763 HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:74)
	at co.cask.cdap.app.etl.batch.TPFSSinkSourceTest.verifyTPFSData(TPFSSinkSourceTest.java:135)
	at co.cask.cdap.app.etl.batch.TPFSSinkSourceTest.testStreamTPFSWithProjection(TPFSSinkSourceTest.java:124)
	at co.cask.cdap.app.etl.batch.TPFSSinkSourceTest.testSpark(TPFSSinkSourceTest.java:85)
java.lang.RuntimeException: java.util.concurrent.TimeoutException: Timeout occurred. Expected true but found false.
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:70)
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:91)
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:130)
	at co.cask.cdap.test.remote.RemoteServiceManager.getServiceURL(RemoteServiceManager.java:86)
	at co.cask.cdap.app.etl.batch.TPFSSinkSourceTest.verifyTPFSData(TPFSSinkSourceTest.java:131)
	at co.cask.cdap.app.etl.batch.TPFSSinkSourceTest.testStreamTPFSWithProjection(TPFSSinkSourceTest.java:124)
	at co.cask.cdap.app.etl.batch.TPFSSinkSourceTest.testMR(TPFSSinkSourceTest.java:71)
java.lang.RuntimeException: java.io.IOException: 500: Connection refused: it-itc-cm512-109-31983-1005.dev.continuuity.net/10.210.0.9:41116
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.doPost(RemoteKeyValueTable.java:170)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.write(RemoteKeyValueTable.java:96)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.write(RemoteKeyValueTable.java:101)
	at co.cask.cdap.app.etl.batch.ValueMapperTest.test(ValueMapperTest.java:120)
java.io.IOException: 409: Dataset 'xmlreadersource' already exists
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:74)
	at co.cask.cdap.app.etl.batch.XMLReaderTest.testSetup(XMLReaderTest.java:89)
java.io.IOException: 503: No discoverable found for request PUT /v3/namespaces/itncm/apps/UploadFile/versions/-SNAPSHOT/services/FileSetService/methods/xmlreadersource?path=catalog.xml HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:69)
	at co.cask.cdap.app.etl.batch.XMLReaderTest.testSetup(XMLReaderTest.java:93)
java.lang.RuntimeException: java.util.concurrent.TimeoutException: Timeout occurred. Expected true but found false.
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:70)
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:91)
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:130)
	at co.cask.cdap.test.remote.RemoteServiceManager.getServiceURL(RemoteServiceManager.java:86)
	at co.cask.cdap.app.etl.batch.XMLReaderTest.testSetup(XMLReaderTest.java:86)
java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/UploadFile/versions/-SNAPSHOT/services/FileSetService/methods/xmlreadersource/create HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:74)
	at co.cask.cdap.app.etl.batch.XMLReaderTest.testSetup(XMLReaderTest.java:89)
java.io.IOException: 409: Dataset 'xmlreadersource' already exists
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:74)
	at co.cask.cdap.app.etl.batch.XMLReaderTest.testSetup(XMLReaderTest.java:89)
java.io.IOException: 409: Dataset 'testFileSet' already exists
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:74)
	at co.cask.cdap.app.etl.realtime.DataStreamsTest.testDataStreams(DataStreamsTest.java:98)
java.io.IOException: 503: No discoverable found for request PUT /v3/namespaces/itncm/apps/dataprep/versions/-SNAPSHOT/services/service/methods/workspaces/test_ws HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:74)
	at co.cask.cdap.app.etl.wrangler.WranglerServiceTest.createAndUploadWorkspace(WranglerServiceTest.java:131)
	at co.cask.cdap.app.etl.wrangler.WranglerServiceTest.test(WranglerServiceTest.java:118)
java.io.IOException: 503: No discoverable found for request GET /v3/namespaces/itncm/apps/DatasetAccessApp/versions/-SNAPSHOT/services/SnapshotFilesetService/methods/read/SnapshotAvro HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:74)
	at co.cask.cdap.app.etl.wrangler.WranglerTest.readOutput(WranglerTest.java:237)
	at co.cask.cdap.app.etl.wrangler.WranglerTest.testWrangler(WranglerTest.java:219)
	at co.cask.cdap.app.etl.wrangler.WranglerTest.testWranglerMR(WranglerTest.java:85)
java.io.IOException: 503: No discoverable found for request GET /v3/namespaces/itncm/apps/DatasetAccessApp/versions/-SNAPSHOT/services/SnapshotFilesetService/methods/read/SnapshotAvro HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:74)
	at co.cask.cdap.app.etl.wrangler.WranglerTest.readOutput(WranglerTest.java:237)
	at co.cask.cdap.app.etl.wrangler.WranglerTest.testWrangler(WranglerTest.java:219)
	at co.cask.cdap.app.etl.wrangler.WranglerTest.testWranglerSpark(WranglerTest.java:99)
java.io.IOException: 503: No discoverable found for request GET /v3/namespaces/itncm/apps/PermissionApp/versions/-SNAPSHOT/services/FileService/methods/list/pfs HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:69)
	at co.cask.cdap.app.fileset.PermissionTest.validateGroupAndPermissions(PermissionTest.java:227)
	at co.cask.cdap.app.fileset.PermissionTest.validateGroupAndPermissions(PermissionTest.java:220)
	at co.cask.cdap.app.fileset.PermissionTest.test(PermissionTest.java:143)
java.util.concurrent.TimeoutException: Timeout occurred. Expected true but found false.
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:70)
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:91)
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:130)
	at co.cask.cdap.test.AbstractProgramManager.waitForRuns(AbstractProgramManager.java:81)
	at co.cask.cdap.test.AbstractProgramManager.waitForRun(AbstractProgramManager.java:75)
	at co.cask.cdap.app.mapreduce.readless.ReadlessIncrementTest.testReadlessIncrementsInMapReduce(ReadlessIncrementTest.java:67)
java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/HangingWorkerDataset/versions/-SNAPSHOT/services/DatasetService/methods/read HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.doPost(RemoteKeyValueTable.java:170)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.doPost(RemoteKeyValueTable.java:163)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.read(RemoteKeyValueTable.java:77)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.read(RemoteKeyValueTable.java:70)
	at co.cask.cdap.app.restart.HangingWorkerTest$1.call(HangingWorkerTest.java:61)
(3 more lines...)
java.io.IOException: 503: No discoverable found for request GET /v3/namespaces/itncm/apps/ServiceApplication/versions/-SNAPSHOT/services/HttpService/methods/read/testKey HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:69)
	at co.cask.cdap.app.serviceworker.ServiceWorkerTest.test(ServiceWorkerTest.java:82)
java.io.IOException: 503: No discoverable found for request GET /v3/namespaces/itncm/apps/ConfigTestApp/versions/v2/services/simpleService/methods/ping HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:69)
	at co.cask.cdap.apps.ApplicationVersionTest.testRouteConfig(ApplicationVersionTest.java:197)
java.io.IOException: 503: No discoverable found for request GET /v3/namespaces/itncm/apps/ConfigTestApp/versions/v1-SNAPSHOT/services/simpleService/methods/ping HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:69)
	at co.cask.cdap.apps.ApplicationVersionTest.testAppVersionsCreationUpdateDeletion(ApplicationVersionTest.java:80)
java.util.concurrent.TimeoutException: Time limit reached. Got '0' instead of '1'
	at co.cask.cdap.client.MetricsClient$3.doWaitFor(MetricsClient.java:286)
	at co.cask.cdap.client.MetricsClient$3.waitForProcessed(MetricsClient.java:256)
	at co.cask.cdap.apps.DatasetTest.test(DatasetTest.java:109)
java.util.concurrent.TimeoutException: Time limit reached. Got '0' instead of '4'
	at co.cask.cdap.client.MetricsClient$3.doWaitFor(MetricsClient.java:286)
	at co.cask.cdap.client.MetricsClient$3.waitForProcessed(MetricsClient.java:256)
	at co.cask.cdap.apps.explore.ExploreTest.sendInputData(ExploreTest.java:245)
	at co.cask.cdap.apps.explore.ExploreTest.test(ExploreTest.java:69)
java.util.concurrent.TimeoutException: Time limit reached. Got '0' instead of '4'
	at co.cask.cdap.client.MetricsClient$3.doWaitFor(MetricsClient.java:286)
	at co.cask.cdap.client.MetricsClient$3.waitForProcessed(MetricsClient.java:256)
	at co.cask.cdap.apps.explore.ExploreTest.sendInputData(ExploreTest.java:245)
	at co.cask.cdap.apps.explore.ExploreTest.testSubqueryInWhereClause(ExploreTest.java:568)
java.io.IOException: 503: No discoverable found for request PUT /v3/namespaces/itncm/apps/FileSetExample/versions/-SNAPSHOT/services/FileSetService/methods/lines?path=myFile.txt HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:69)
	at co.cask.cdap.apps.fileset.FileSetTest.test(FileSetTest.java:72)
java.io.IOException: 503: No discoverable found for request PUT /v3/namespaces/itncm/apps/PFSApp/versions/-SNAPSHOT/services/PFSService/methods/0 HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:69)
	at co.cask.cdap.apps.fileset.PartitionCorrectorTest.test(PartitionCorrectorTest.java:65)
java.io.IOException: 503: No discoverable found for request PUT /v3/namespaces/itncm/apps/PFSApp/versions/-SNAPSHOT/services/PFSService/methods/1 HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:69)
	at co.cask.cdap.apps.fileset.PartitionedFileSetUpdateTest.test(PartitionedFileSetUpdateTest.java:74)
java.util.concurrent.TimeoutException: Time limit reached. Got '0' instead of '1'
	at co.cask.cdap.client.MetricsClient$3.doWaitFor(MetricsClient.java:286)
	at co.cask.cdap.client.MetricsClient$3.waitForProcessed(MetricsClient.java:256)
	at co.cask.cdap.apps.metadata.PurchaseMetadataTest.testLineage(PurchaseMetadataTest.java:121)
java.util.concurrent.TimeoutException: Time limit reached. Got '0' instead of '1'
	at co.cask.cdap.client.MetricsClient$3.doWaitFor(MetricsClient.java:286)
	at co.cask.cdap.client.MetricsClient$3.waitForProcessed(MetricsClient.java:256)
	at co.cask.cdap.apps.purchase.PurchaseAudiTest.test(PurchaseAudiTest.java:95)
java.util.concurrent.TimeoutException: Timeout occurred. Expected true but found false.
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:70)
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:91)
	at co.cask.cdap.common.utils.Tasks.waitFor(Tasks.java:130)
	at co.cask.cdap.test.AbstractProgramManager.waitForRuns(AbstractProgramManager.java:81)
	at co.cask.cdap.test.AbstractProgramManager.waitForRun(AbstractProgramManager.java:75)
	at co.cask.cdap.apps.spark.sparkpagerank.SparkPageRankAppTest.test(SparkPageRankAppTest.java:141)
java.util.concurrent.TimeoutException: Time limit reached. Got '0' instead of '20'
	at co.cask.cdap.client.MetricsClient$3.doWaitFor(MetricsClient.java:286)
	at co.cask.cdap.client.MetricsClient$3.waitForProcessed(MetricsClient.java:256)
	at co.cask.cdap.apps.tracker.TrackerTestBase.waitforProcessed(TrackerTestBase.java:115)
	at co.cask.cdap.apps.tracker.TrackerTest.test(TrackerTest.java:52)
java.util.concurrent.TimeoutException: Time limit reached. Got '0' instead of '1'
	at co.cask.cdap.client.MetricsClient$3.doWaitFor(MetricsClient.java:286)
	at co.cask.cdap.client.MetricsClient$3.waitForProcessed(MetricsClient.java:256)
	at co.cask.cdap.apps.transaction.TransactionTimeoutTest.testFlowletTimeouts(TransactionTimeoutTest.java:65)
java.util.concurrent.TimeoutException: Time limit reached. Got '0' instead of '2'
	at co.cask.cdap.client.MetricsClient$3.doWaitFor(MetricsClient.java:286)
	at co.cask.cdap.client.MetricsClient$3.waitForProcessed(MetricsClient.java:256)
	at co.cask.cdap.apps.wordcount.WordCountTest.test(WordCountTest.java:92)
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/myCube/versions/-SNAPSHOT/services/DatasetService/methods/add HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.cube.RemoteCube.doPost(RemoteCube.java:116)
	at co.cask.cdap.remote.dataset.cube.RemoteCube.add(RemoteCube.java:72)
	at co.cask.cdap.remote.dataset.test.RemoteCubeTest.test(RemoteCubeTest.java:66)
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/kvTable/versions/-SNAPSHOT/services/DatasetService/methods/read HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.doPost(RemoteKeyValueTable.java:170)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.doPost(RemoteKeyValueTable.java:163)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.read(RemoteKeyValueTable.java:77)
	at co.cask.cdap.remote.dataset.kvtable.RemoteKeyValueTable.read(RemoteKeyValueTable.java:70)
	at co.cask.cdap.remote.dataset.test.RemoteKeyValueTest.test(RemoteKeyValueTest.java:37)
java.lang.RuntimeException: java.io.IOException: 503: No discoverable found for request POST /v3/namespaces/itncm/apps/table/versions/-SNAPSHOT/services/DatasetService/methods/get HTTP/1.1
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:132)
	at co.cask.cdap.client.util.RESTClient.execute(RESTClient.java:91)
	at co.cask.cdap.remote.dataset.table.RemoteTable.doPost(RemoteTable.java:139)
	at co.cask.cdap.remote.dataset.table.RemoteTable.doPost(RemoteTable.java:132)
	at co.cask.cdap.remote.dataset.table.RemoteTable.get(RemoteTable.java:64)
	at co.cask.cdap.remote.dataset.test.RemoteTableTest.test(RemoteTableTest.java:40)