How to join on multiple columns in Pyspark?

In this article, we will discuss how to join multiple columns in PySpark Dataframe using Python.

Let's create the first dataframe:

Output:

Let's create the second dataframe:

Output:

we can join the multiple columns by using join() function using conditional operator

Syntax: dataframe.join(dataframe1, (dataframe.column1== dataframe1.column1) & (dataframe.column2== dataframe1.column2))

where, 

• dataframe is the first dataframe
• dataframe1 is the second dataframe
• column1 is the first matching column in both the dataframes
• column2 is the second matching column in both the dataframes

Example 1: PySpark code to join the two dataframes with multiple columns (id and name)

Output:

Example 2: Join with or operator

Output: