logo
down
shadow

InvocationTargetException. Cannot cast class X to class X. When invoked in Scala Imain through spark-submit


InvocationTargetException. Cannot cast class X to class X. When invoked in Scala Imain through spark-submit

Content Index :

InvocationTargetException. Cannot cast class X to class X. When invoked in Scala Imain through spark-submit
Tag : java , By : Milander
Date : November 29 2020, 09:01 AM

This might help you Okay. So we figured out how to solve the problem for us.
I think IMain uses a different classloader to load classes then the one they are supposed to be loaded with. Anyways, the following solves the problem, leaving it for others to have a look.
val interpreter = new IMain(settings){
  override protected def parentClassLoader: ClassLoader = this.getClass.getClassLoader
}

Comments
No Comments Right Now !

Boards Message :
You Must Login Or Sign Up to Add Your Comments .

Share : facebook icon twitter icon

Scala - Dynamic class loading - class A can not be cast to class A


Tag : class , By : Paul
Date : March 29 2020, 07:55 AM
I think the issue was by ths following , Your code implies that you have "A" available in one classLoader context where you are calling clazz.newInstance.asInstanceOf[A] which is a separate context from where you are getting the clazz object. The problem is that you have two different instances of the class "A" in two different classLoader contexts. An object that is created from one version of class "A" cannot be cast to an instance of the other version in a different classLoader context.

Importing class files into the Scala Interpreter IMain


Tag : scala , By : Igor Carron
Date : March 29 2020, 07:55 AM
I hope this helps . I am trying to use the IMain method from scala's interpreter to run a function that has been converted into a string. However I am unable to import user created classes into the interpreter. , Have you tried the following:
val m = new IMain() {
   override protected def parentClassLoader = sounder.Sounder.getClassLoader
}
val s = new tools.nsc.Settings()
s.embeddedDefaults[sounder.Sounder]
val m = new IMain(s)

spark-submit Error: No main class set in JAR; please specify one with --class


Tag : apache-spark , By : user137798
Date : March 29 2020, 07:55 AM
wish help you to fix your issue I am trying to execute a spark application using spark-submit. , Try providing --class parameter first before ./SparkExamples.jar
spark-submit --master yarn  --class com.examples.WordCount ./SparkExamples.jar

how to cast a spark row(StructType) to scala case class


Tag : scala , By : Laques
Date : November 18 2020, 04:01 AM
it should still fix some issue The problem is that .as on Row does just a typecast nothing else. the internal type of trips is actually Row
so row.getAs[WrappedArray[Row]]("trips") will work. then you can map over it and construct myRow from Row.

java.lang.NoClassDefFoundError: Could not initialize class when launching spark job via spark-submit in scala code


Tag : java , By : Martin
Date : March 29 2020, 07:55 AM
Related Posts Related QUESTIONS :
  • Finding dimensions of a .gif file
  • Java Number format how to change +/- sign to custom text
  • Entity partially saved when using JOINED inheritance strategy and setting spring.jpa.properties.hibernate.jdbc.batch_siz
  • Stored Procedure in Java Spring Boot Project returns null as Output
  • How to solve org.hibernate.MappingException which is causing due to inheriting a class
  • Clean Archtecture. Understanding of scheme
  • Processing 3 triangle not showing in Javafx 8 Window tab
  • How to specify a sequence-based generated value in Hibernate 5 via legacy mapping
  • Spring-boot application not getting auto-deployed on startup
  • How to only pass strings that the user select
  • Is there a way to SELECT using "GREATEST(field1, field2)" where field1 and field2 are aggregate sums in the sa
  • How to handle JSON objects wrapped into one JSON object with retrofit2?
  • Configure Hazelcast CPSubsystem Retries Timeout
  • how to use onBindViewHolder with multiple items in android RecyclerView
  • No ParameterResolver registered for parameter in BeforeAll method
  • Finding the path in a graph with the least casualties according to the lanchester square law
  • MongoWriteException when inserting into Mongodb with composite custom _id
  • Fetch Oracle procedure metadata with Java when multiple procedure signatures
  • Value modification of key-pair in HashMap and impact for a HashCode
  • Migration from solrj to spring-data-solr
  • How to check if you're still connected to the database with jpa
  • Use Date type in the graphql scheme
  • Split and add the string based on length
  • Is "main" method of spring boot application required when deploy as war
  • Getting the average within specific numbers in an array
  • how to use izpack to make my jar application to installer?
  • What is meant by src in Java Eclipse?
  • Create a mirrored linked list in Java
  • Examples of good JPA Java Desktop Application
  • Translate Java to Python -- signing strings with PEM certificate files
  • Algorithm Analysis tool for java
  • Java serial comm API - what does inputstream.read() return if a timeout occurs?
  • How do I make a background thread in Java that allows the main application to exit completely? This works in Linux, but
  • How to add an image dynamically at runtime in java
  • Java App on Mac asking for allow network connections everytime
  • Best actively maintained Java XMPP Library?
  • Multi-Threaded Application - Help with some pseudo code!
  • Scoping a StringBuilder inside a for loop
  • How to specify hash algorithm when updating LDAP via Java?
  • Class not found exception (org.apache.openjpa.enhance.PersistenceCapable) thrown in a client of WLS 10
  • In Java ,where in memory are class functions put?
  • How do I test expectedExceptionsMessageRegExp (exception message) using TestNG?
  • Help In understanding Multi Dimentional Arrays
  • No bean named '...' is defined and Spring @Resource annotation
  • Singleton design pattern vs Singleton beans in Spring container
  • flashvars object was not working in mozilla browser
  • Shell script to import mysql dump file
  • What are the best practices to separate data from users
  • May I use com.google.code prefix for my packages?
  • How to set classpath in manifest file , while creating JAR from eclipse?
  • dealing with voice in java
  • Error: java.security.AccessControlException: Access denied
  • How to verify the root trust of a ceritifcate
  • Searching for a standalone JSP compiler
  • Spring 2.5 managed servlets: howto?
  • iBatis get executed sql
  • GRAPH: find an algorithm to determine the shortest path from one point to another in a rectangular maze?
  • Efficient JSON encoding for data that may be binary, but is often text
  • How to Read Java File Structure using Java?
  • Java-Hibernate-Newbie: How do I acces the values from this list?
  • shadow
    Privacy Policy - Terms - Contact Us © scrbit.com