Data proc throwing errors while pyspark code which is developed in lower of pyspark of Data proc. How to handle these kind of issues, is there any backword copatabilty plugin to get lower version code exeucted in Data proc. On primse version of pyspark 2.4.7 and in GCP data proc version of Pyspark is 3.1.3. Let us know if you have seen any backward compatability issues while running the pyspark jobs in Dataproc of GCP.
LinkedIn
Twitter
