Java Spark Tips, Tricks and Basics 2 – How to add columns to Datasets / Dataframes in Spark Java

This tutorial will show you how to add a new column to an already existing dataset /dataframe .

First we create a dataset.

Dataset<Row> data = spark.read().format("csv").load("path/to/your/CSV.csv");

1	Dataset<Row> data = spark.read().format("csv").load("path/to/your/CSV.csv");

Then we add a column with lit

Dataset<Row> data = data.withColumn("newColumn", lit(1));

1	Dataset<Row> data = data.withColumn("newColumn", lit(1));

and we are done!