Datasets with more than 1 question don't work

[Perevalov]

I try to use my own dataset while evaluating a QA system, however, after I configure and start the experiment nothing happens -- "The experiment is still running.", but the system doesn't receive the questions.

Occasionally, I tried to upload the dataset with only one question in it -- it worked, but I still want to evaluate on all the data I have.

I use this endpoint: http://gerbil-qa.aksw.org/gerbil/config

[RicardoUsbeck]

Hi, under http://gerbil-qa.aksw.org/gerbil/running you can see what GERBIL is doing. So the format is correct but since we are collect owl:sameAs resources for the answer convex hull, it has not yet started sending requests to your system, or @MichaelRoeder

[MichaelRoeder]

Yes, it tried to collect the convex hulls. Unfortunately, the service got stuck during that and I had to restart it. @Perevalov feel free to start your experiment again. Please let us know when you encounter a very long runtime again.

[Perevalov]

Yes, it tried to collect the convex hulls. Unfortunately, the service got stuck during that and I had to restart it. @Perevalov feel free to start your experiment again. Please let us know when you encounter a very long runtime again.

@MichaelRoeder Thanks for solving this. I have done several successful experiments today, however, it seems like it again got stuck:

state=WAITING
progress=100.0% of dataset
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
java.util.concurrent.Semaphore.acquire(Semaphore.java:467)
org.aksw.gerbil.semantic.sameas.impl.cache.FileBasedCachingSameAsRetriever.retrieveSameURIs(FileBasedCachingSameAsRetriever.java:134)
org.aksw.gerbil.semantic.sameas.impl.AbstractSameAsRetrieverDecorator.addSameURIs(AbstractSameAsRetrieverDecorator.java:43)
org.aksw.gerbil.execute.ExperimentTask.runExperiment(ExperimentTask.java:560)
org.aksw.gerbil.execute.ExperimentTask.run(ExperimentTask.java:167)
org.aksw.simba.topicmodeling.concurrent.workers.WorkerImpl.run(WorkerImpl.java:44)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:748)
eTConfig("QAnswer (WS)","QALD+ Train Wikidata (uploaded)","QA","STRONG_ENTITY_MATCH")
state=WAITING
progress=100.0% of dataset
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
java.util.concurrent.Semaphore.acquire(Semaphore.java:312)
org.aksw.gerbil.semantic.sameas.impl.cache.FileBasedCachingSameAsRetriever.retrieveSameURIs(FileBasedCachingSameAsRetriever.java:132)
org.aksw.gerbil.semantic.sameas.impl.AbstractSameAsRetrieverDecorator.addSameURIs(AbstractSameAsRetrieverDecorator.java:43)
org.aksw.gerbil.execute.ExperimentTask.runExperiment(ExperimentTask.java:560)
org.aksw.gerbil.execute.ExperimentTask.run(ExperimentTask.java:167)
org.aksw.simba.topicmodeling.concurrent.workers.WorkerImpl.run(WorkerImpl.java:44)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:748)

[Perevalov]

@MichaelRoeder It's stuck again. Could you restart? What is the possible reason for this. Too large datasets maybe?