Join DataFrames

Question 1

If the two dataframes have columns with the same name, how can you join the two datasets

Answer 1

dataset1.join(dataset2, dataset1.col(“address_id”) === dataset2.col(“address_id”))

Question 2

What is the default join

Answer 2

inner join

Question 3

with union, how is the data merge

Answer 3

based on the position of the columns and not the name of the columns
only as long as the data type is the same

Question 4

How can you union by column name

Answer 4

.unionByName