Spark jobs fail on training #19
Description
Hi,
I have installed the docker version of UR and tried a very simple quickstart check.
I have created an instance of UR as follows:
{
"engineId": "myur",
"engineFactory": "com.actionml.engines.ur.UREngine",
"sparkConf": {
"master": "local",
"spark.serializer": "org.apache.spark.serializer.KryoSerializer",
"spark.kryo.registrator": "org.apache.mahout.sparkbindings.io.MahoutKryo
Registrator",
"spark.kryo.referenceTracking": "false",
"spark.kryoserializer.buffer": "300m",
"spark.executor.memory": "3g",
"spark.driver.memory": "3g",
"spark.es.index.auto.create": "true",
"spark.es.nodes": "http://elasticsearch:9200",
"es.nodes": "http://elasticsearch:9200",
"spark.es.nodes.wan.only": "true",
"es.nodes.wan.only": "true"
},
"algorithm":{
"indicators": [
{
"name": "buy"
},{
"name": "view"
}
]
}
}
Then I have performed
hctl add myur
and added the instance to UR
I have then created the following event:
curl -i -X POST http://harness:9090/engines/myur/events
-H "Content-Type: application/json"
-d '{
"event" : "buy",
"entityType" : "user",
"entityId" : "Joe Doe",
"targetEntityType" : "item",
"targetEntityId" : "iPad",
"eventTime" : "2021-06-05T21:"
}'
After that I have performed training as:
curl -i -X POST http://harness:9090/engines/myur/jobs
-H "Content-Type: application/json"
-d '{}'
or alternatively as
hctl train myur
The answer was:
Asking engine: myur to train
{
"comment": "Started train Job on Spark",
"description": {
"comment": "Spark job",
"createdAt": "2021-06-18T15:12:50.361Z",
"jobId": "a82060ad-5bc8-4b3a-b7a0-f28d44eafa00",
"status": {
"name": "queued"
}
}
}
But then asking for
hctl status engines
the answer is
{
"comment": "Spark job",
"completedAt": "2021-06-18T15:12:53.722Z",
"createdAt": "2021-06-18T15:12:50.361Z",
"jobId": "a82060ad-5bc8-4b3a-b7a0-f28d44eafa00",
"status": {
"name": "failed"
}
And any query returns
_HTTP/1.1 500 Internal Server Error
Server: ActionMLRouter/10.0.9
Date: Fri, 18 Jun 2021 15:14:28 GMT
Content-Type: text/plain; charset=UTF-8
Content-Length: 35
There was an internal server error._
Any hints on that?
Thank you in advance.
Luigi