InvocationTargetException. Cannot cast class X to class X. When invoked in Scala Imain through spark-submit

I think the issue was by ths following , Your code implies that you have "A" available in one classLoader context where you are calling clazz.newInstance.asInstanceOf[A] which is a separate context from where you are getting the clazz object. The problem is that you have two different instances of the class "A" in two different classLoader contexts. An object that is created from one version of class "A" cannot be cast to an instance of the other version in a different classLoader context.

I hope this helps . I am trying to use the IMain method from scala's interpreter to run a function that has been converted into a string. However I am unable to import user created classes into the interpreter. , Have you tried the following:

val m = new IMain() {
   override protected def parentClassLoader = sounder.Sounder.getClassLoader
}

val s = new tools.nsc.Settings()
s.embeddedDefaults[sounder.Sounder]
val m = new IMain(s)

wish help you to fix your issue I am trying to execute a spark application using spark-submit. , Try providing --class parameter first before ./SparkExamples.jar

spark-submit --master yarn  --class com.examples.WordCount ./SparkExamples.jar

it should still fix some issue The problem is that .as on Row does just a typecast nothing else. the internal type of trips is actually Row
so row.getAs[WrappedArray[Row]]("trips") will work. then you can map over it and construct myRow from Row.