Configuring a JDBC connection

Working with different systems brings the challenge of finding an efficient way to connect the systems. An adaptor, or a driver, is the solution to this communication problem, creating a bridge to translate information from one system to another.

JDBC, or Java Database Connectivity, is used to facilitate communication between Java-based systems and databases. This recipe covers configuring JDBC in SparkSession to connect to a PostgreSQL database, using best practices as always.

Getting ready

Before configuring SparkSession, we need to download the .jars file (Java Archive). You can do this at https://jdbc.postgresql.org/ on the PostgreSQL official site.

Select Download, and you will be redirected to another page:

Figure 5.1 – PostgreSQL JDBC home page

Then, select the Java 8 Download button.

Keep this .jar file somewhere safe, as you will need it later. I suggest keeping it inside the folder where your...