Author name: Surender Godara

Surender Godara is a Senior Data Engineer at Dataworkz, where he works on the AI platform and the LLM and agent systems behind it, along with the distributed data infrastructure that supports them. He brings more than a decade of experience building large-scale data platforms, with particular depth in Apache Spark and distributed systems.

Data Engineering

How Can Advanced Logical Plan Optimization Mitigate Data Skewness in Spark?

By Surender Godara / December 18, 2023

When working with massive datasets in Spark, processing billions of rows distributed across multiple cluster nodes, handling data skewness becomes […]

Data Engineering

What is Data Skewness in Spark and How Does It Impact EL+T System Performance?

By Surender Godara / December 18, 2023

In this blog, we will explore the concept of data skewness in Spark and understand the significant impact it can

Product

Learn

Resources

Accelerate GenAI adoption with rapid experimentation and iteration using Agentic RAG

DataWorkz