Class not found - catalog.TableProvider

[shaharluftig]

Hey guys, my company uses spark 2.4, and when I am trying to write to weviate the following error eccurs:

Class not found : org.apache.spark.sql.connector.catalog.TableProvider

Is it because of my spark version? Or I'm doing something wrong

[samos123]

I think this is because you're using 2.4, you need Spark 3 or later. I think 2.4 has been EOLed already by the Spark community as well. I would recommend upgrading Spark to 3.2 or Spark 3.3.