What is the Data Engineering Tech Radar?

This radar is a curated, opinionated guide to the landscape of data tools, platforms, and concepts. It's a living document that reflects my experience and perspective on the data engineering ecosystem, inspired by the original ThoughtWorks Tech Radar and built using the Zalando Radar visualization library.

Quadrants

• Languages & Frameworks: This quadrant covers the foundational skills, languages and frameworks.
• Transformation & Orchestration: Tools and practices for data transformation, ETL processes, and workflow orchestration.
• Data Platforms & Storage: Technologies for data storage, databases, and data warehousing solutions.
• Data Analytics: Tools and platforms for data analysis, visualization, and business intelligence.

Rings

• ADOPT: Technologies that are well-established and I have used or seen other teams adopt them in production and they've proven their value.
• TRIAL: Emerging technologies that show promise and I have started exploring them or using on non-critical projects.
• ASSESS: Technologies that caught my eye and are used or recommended by other teams that I think are worth exploring.
• HOLD: Technologies to proceed with caution on and I would not recommended for new projects.

The Purpose

The goal of this radar is to provide a structured way to navigate the complex and rapidly evolving landscape of data engineering technologies. It serves as a personal knowledge base to track the adoption and development of tools, showcase hands-on experience, and offer an opinionated perspective on the state of data engineering. The radar is not exhaustive but aims to spark conversations and help others make informed decisions about the technologies they choose.