The AI Rocket Ship

intelligence.join(analytics, on=["smarts"], how="full outer")

rocket-ship

A ship that runs on rockets, because engineering, Image © Shaurya Agarwal, 2026

Long-form posts on AI, machine learning, data engineering and other technology topics, in collaboration with my team

Slow Changing Dimensions

01 Slow Changing Dimensions - A Palantir Foundry Perspective

Collaborators:

  1. Prashant Jha, LinkedIn
  2. Anudeep Chatradi, LinkedIn
  3. Yogesh Raja, LinkedIn
  4. Abhishek Narayan Chaudhury, LinkedIn
  5. Shaurya Agarwal

View on GitHub

02.1 Spark Declarative Pipelines

Collaborators:

  1. Ankita Hatibaruah, LinkedIn
  2. Pavithra Ananthakrishnan, LinkedIn
  3. Sree Bhavya Kanduri, LinkedIn

View on GitHub

Spark Declarative Pipelines
Spark 4.1 Release Notes

02.2 More notes on Spark 4.1 release

Collaborators:

  1. Ankita Hatibaruah, LinkedIn
  2. Pavithra Ananthakrishnan, LinkedIn
  3. Sree Bhavya Kanduri, LinkedIn

View on GitHub

03 MLOps in Palantir Foundry

Collaborators:

  1. Anudeep Chatradi, LinkedIn
  2. Abhishek Narayan Chaudhury, LinkedIn

View on GitHub

MLOps in Palantir Foundry
GenAI Applications in Palantir Foundry (AIP)

04 GenAI Applications in Palantir Foundry (AIP)

Collaborators:

  1. Harsh Gautam, LinkedIn
  2. Vrinda Makkar, LinkedIn
  3. Chinmay Sutar, LinkedIn

View on GitHub

05 Leveraging DSPy with Foundry AIP: Adaptive AI Meets Enterprise-Grade Infrastructure

Collaborators:

  1. Nilesh Saraf, LinkedIn
  2. Abhishek Narayan Chaudhury, LinkedIn

View on GitHub

MLOps in Palantir Foundry
GenAI Applications in Palantir Foundry (AIP)

06 Palantir Foundry vs Traditional Cloud Data Platforms

Collaborators:

  1. Prashant Jha, LinkedIn
  2. Ankita Hatibaruah, LinkedIn
  3. Pavan Kumar Busetty, LinkedIn

View on GitHub

07 Data Preparation for AI

Collaborators:

  1. Pavan Kumar Busetty, LinkedIn
  2. Shivani Patil, LinkedIn
  3. Shruti Raj, LinkedIn
  4. Jaya Chandran, LinkedIn

View on GitHub

Data Preparation for AI