MDS Newsletter #11

Aayush Jain -

Hey All 👋

We are glad to announce that  MDS Twitter has crossed 1000 followers today!
Thank you for all the love and support!

In this newsletter edition, we'll take you through this week's featured tools - Astronomer & Mixpanel, some useful resources on hot topics from MDS, upcoming data events, some data stack jobs, and more!

Here are this week's featured companies from the Modern Data Stack.

Astronomer helps enterprises adopt Apache Airflow, the leading open-source data workflow orchestration platform that helps organizations get their data in motion.

Mixpanel is a self-serve product analytics tool, that helps to unlock the valuable insights of user interaction to convert, engage and retain users. It provides real-time data on how people use your product that's easy to understand.

Good reads & resources

Keep pace with the latest developments in the modern data stack. Always be learning!

Anna Filipova: In her article, Anna discusses how Analytics professionals, who she refers to as 'purple people', bridge the gap between the other two types - people who have a deep understanding of business, knows what data they need but don't have a skill set to design a data architecture (red people) and those who have the technical knowledge to build a data architecture but do not understand business requirements (blue people).
Read the full article here We the purple people.

Nick Handle: In this article, Nick has discussed the origin of the concept of ‘metric store’, its evolution since then, and how tech companies like Airbnb, Uber, Spotify, LinkedIn built an in-house metric store before tools like Transform were commercially available. Nick has also discussed how metrics store is gaining traction as an individual category in the modern data stack and how its future looks like. Here's the link to the article A brief history of the metrics store

Colleen Tartow: In this article, Collen has explained how organizations should measure their data maturity and why data should be treated as a Product. Read the full article here The Evolution Toward Data Maturity

Sarah Krasnik: Pipeline tests come in many different shapes and sizes. It’s hardest when starting from scratch with a new testing framework; once you get started, it’s off to the races. So how do you decide what to actually test? To know this answer, read this article by Sarah on Distinguishing Critical Pipeline Tests From Metrics

Catalog & Cocktails: In this podcast Tim Gasper, Juan Sequeda along with special guest Nick Schrock talks about what holds the modern data stack together and makes it the architecture of choice for so many data-driven enterprises. Here's the link to the article: Modern Data Stack: Technology, Methodology, or both?

Upcoming data stack events & webinars

Upcoming conferences, summits, and webinars for you. Start networking!

Evanta is organizing CDO Executive Summit in New York on 9th December!

Evanta is a community built by and for C- level executives to share innovative ideas and solve leadership challenges through peer-to-peer collaboration.
Click here to register.

Hevo Data is organizing a virtual summit on Augment Cloud Data Warehousing Summit on 9th Dec 2021.

The event will help global data engineers, architects, and other data professionals to gain hands-on experience on the latest cloud warehousing platforms.
Register here.

Bigeye Data is organizing the "Data Reliability Engineering" Conference on 14th December. It is a virtual event.

Join the event to hear from data engineering teams, data analysts, scientists, modern data stack companies and other data enthusiasts working to solve the most complex data reliability problems enterprises are currently facing.
Here's the link to register

MDS Jobs

Datadog is hiring a 'Data Engineer'
Location: ‌Boston, Massachusetts, USA
Tags: Spark, Luigi, Kafka, Hadoop

Dbt labs is hiring an 'Analytics Engineer'
Location: Remote
Tags: Lyft, Monzo, GitLab, Snowflake

Disney is hiring a 'Data Scientist'
Location: Santa Monica, California, United States
Tags: Spark, Beam, Hadoop, Bigquery

GoCanvas is hiring a 'Senior Data Engineer'
Location: Remote
Tags: dbt, Looker, SQL, Airflow, Luigi, GIT

What's trending on Twitter in the Data Stack world!

Just for fun

If you've made it this far, you deserve a meme😄

If you enjoyed this newsletter, please forward it to your friends who dig the 'Modern Data Stack' movement! (or you can just send them this link).

Have suggestions? Contact us here!