Pyspark Leftouter join with the dataframes
Budget: $10 – $30 USD
Pyspark Leftouter join with the dataframes
I have 2 dataframes, wanted to do leftouter join and select the coloumns only from left table
registering the temp tables and doing spark.sql is working as expected,
wanted to a solution using dataframes
Basically i'm looking for this
SELECT <all the columns from A>
FROM Table_A A
LEFT JOIN Table_B B
ON A.Key = B.Key
WHERE B.Key IS NULL
I have 2 dataframes, wanted to do leftouter join and select the coloumns only from left table
registering the temp tables and doing spark.sql is working as expected,
wanted to a solution using dataframes
Basically i'm looking for this
SELECT <all the columns from A>
FROM Table_A A
LEFT JOIN Table_B B
ON A.Key = B.Key
WHERE B.Key IS NULL