MDS Newsletter #106
Are you almost data-dizzy from our weekly newsletter? (Wink, wink!) Well, hold on tight because we're back with another edition, ready to take your data knowledge to new heights!
This week, discover game-changing tools shaping the future of data warehousing and enterprise data lake management, learn how to build impressive data apps with Streamlit and Snowflake in the reading resources, and if you're wrangling complex data workflows, we've got insights on Apache Airflow and Cloud Composer too.
So, why wait? dive right in!
Featured tools of the week
- Weld: Weld specializes in simplifying data warehousing processes, with the primary objective of making these processes more accessible to a wider range of businesses. They offer a comprehensive data platform that facilitates the easy import of data from a variety of SaaS tools, including custom connectors for tools with APIs. This platform also enables users to efficiently transform, model, and extract insights from their data sources using a versatile SQL editor.
Weld has raised a total of $4.6M in funding over 1 round. This was a Seed round raised on Nov 29, 2021. - Zaloni: Zaloni is a leading provider of enterprise data lake management solutions, including software like Bedrock and Mica, designed to help businesses leverage well-organized big data lakes for a competitive edge. Their integrated platform enhances data lakes with essential features like visibility, governance, and reliability, while also enabling self-service data preparation, reducing reliance on IT. Zaloni Arena introduces augmented data management through an active catalog, simplifying data enrichment and utilization.
Zaloni has raised a total of $24.6M in funding over 4 rounds. Their latest funding was raised on Oct 9, 2020, from a Debt Financing round.
Featured stack of the week
- Bitmetric: It specializes in Data & Analytics, aiming to help clients unlock the value of their data through user-friendly technologies. Their core mission is to empower clients to make better decisions by simplifying complex data issues. They combine their expertise in Business Intelligence and Data Analytics with a proven approach, the Bitmetric Blueprint, to deliver robust and easily integrable solutions.
Here is the data stack of Bitmetric:
Good reads and resources
- Building Data Apps with Streamlit on Snowflake: A Step-by-Step Guide: Streamlit and Snowflake make a great match for building data applications that are interactive, user-friendly and insights-driven. Shritam Kumar Mund provides a comprehensive guide for creating data applications using Streamlit, which is a user-friendly open-source Python library that helps in creating custom web applications using Python code. He explains the process of connecting to Snowflake, a cloud data platform, and how to build a functional data application using Streamlit and Snowflake. He goes through the steps of setting up the environment, creating an app in Streamlit, and integrating it with Snowflake using the Snowflake connector.
- Orchestrate your data pipeline with Apache Airflow and Cloud Composer: Managing complex data workflows can be a time-consuming and tedious task, but with Apache Airflow and Cloud Composer, data management becomes more efficient and manageable. Alex Ravaglia talks about Apache Airflow, an open-source platform for creating, scheduling, and monitoring workflows. He explains how Apache Airflow is useful in creating data pipelines, and how it simplifies the process of orchestrating workflows. He also explains the benefits of using Cloud Composer, a fully managed service built on Apache Airflow, when deploying workflows on Google Cloud Platform.
Upcoming data events, summits and webinars
- The Open Source Analytics Conference (OSA CON) 2023 stands as the premier gathering for enthusiasts of open-source analytics. Attendees converge to expand their knowledge, foster connections, and delve into cutting-edge developments across data ingestion, orchestration, databases, infrastructure, governance, visualization, and AI. The event is scheduled for:
📅 December 12-14, 2022
📍 Online
OSA CON is entirely free and accessible online, making it an inclusive and accessible opportunity for all. Register here.
The call for proposals for OSA CON 2023 is open from September 7th, 2023 to October 12th, 2023. Participants are encouraged to submit insightful talk proposals on various topics, including open-source project reports, innovative data use cases, data storage, visualization, orchestration and more. Get more details here. - The AI + Data Products Workshop is an exciting evening event hosted by experts from Starburst, Immuta, and Kubrick which promises to delve into the dynamic synergy between AI and data products, showcasing their transformative potential in enhancing user experiences and expediting the delivery of groundbreaking business solutions. Details:
📅 October 5th, 2023
⏰ 4:00- 6:00 pm ET
📍 Virginia, USA
Attendees will have the opportunity to gain insights into the profound influence of AI and data products on data capabilities and strategic business objectives. Register for the event here. - Big Data & AI World Asia 2023 is Asia's premier conference where thousands of technologists, data specialists, and AI pioneers come together to explore cutting-edge technologies and the transformative potential of AI.
Details:
📅 October 11-12, 2023
📍 Marina Bay Sands Expo & Convention Centre, Singapore
Join the forefront of business intelligence at this event and witness DataRobot's role in shaping the future of AI. Register here.
MDS Jobs
- Stytch is hiring Data Engineer
Location: NY (Remote)
Stack: Snowflake, Golang, AWS, dbt, Terraform
Apply here - GetGround is hiring Analytics Engineer
Location: London, UK
Stack: dbt, Looker, Bigquery, Snowplow, Python, Airflow
Apply here - Coveo is hiring Business Intelligence Analytics Engineer
Location: Canada - Quebec
Stack: AWS, dbt, Snowflake, Jenkins, Fivetran, Tableau, Hightouch
Apply here
🔥 Trending on Twitter
Just for fun 😀
Are you always hungry for more information and updates about the ever-evolving world of data?
Well, you're in luck! By following us on LinkedIn and Twitter, you'll gain access to all the latest and greatest data content!
But wait, there's more! We want to hear from you - rate us here and let us know how we're doing.
Love it | It's great | Good | Okay-ish | Meh
We welcome any suggestions, articles you would like us to showcase, or data engineering job listings that you may have. Don't hesitate to get in touch with us at [email protected] and we would be delighted to incorporate your input into our next edition.
About Moderndatastack.xyz - We're building a platform to bring together people in the data community to learn everything about building and operating a Modern Data Stack. It's pretty cool - do check it out :)